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ABSTRACT 

A partial survey of the literature on the economics 
of vocational training reveals three important lessons on how 
evaluations may be undertaken using data on pay, inputs, and outputs. 
The first lesson is that social, corporate, and private returns to 
vocational training in developing countries appear to be high enough 
to justify expanding training activity. However, training in 
industrial institutes and vocational secondary schools is less 
cost-effective than more formal firm-based training, at least in 
Kenya, India, and Israel. Also, Latin American data indicate that 
school and formal institutional vocational training may be 
substituted for one another. The second lesson is that in some 
sectors a more labor-intensive method of production is economically 
more effective than current methods. This may, in turn, imply the 
need for more — not less — skilled labor and vocational training. 
Further, given technology and output, unskilled and skilled labor 
appear to be substitutes, rather than complements, in the production 
process. The third lesson is that sophisticated function analyses are 
plagued by statistical and measurement problems. If they are not 
resolved, estimation techniques are unlikely to be able to pick up 
any relationship between trained labor and output among firms. 
However, there are alternatives. Many input and output measures such 
as performance rating and downtime are available for more modest 
evaluations. Training cnh be evaluated using earnings data or output 
and input data. In all cases, there are technical problems including 
sample size, control groups, the use of longitudinal data, and 
difficulties caused by labor mobility. A simpler before/after plant 
level study of changes in inputs or output associated with training 
may offer the most tractable evaluation. (112 references.) 
(Author/CML) 
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Abstract 

This paper (1) presents a partial survey of the literature on the 
economics of vocational training to draw some lessons for evaluations and 
(11) Indicates how such evaluations may be undertaken using data on pay, 
inputs and outputs. 

There are three Important lessons. First, social, corporate and 
private returns to vocational training In developing countries appear to 
be high enough to Justify expanding training activity, however, training 
In Industrial Institutes and vocational secondary schools Is less cost- 
effective than more Informal firm-based training, at least In Kenya. India 
and Israel. Also. Latin American data Indicate that there may be substltuablllty 
between schooling and formal Institutional vocational training. Second. In 
some sectors a more labour-intensive method of production Is economically 
more efficient than current methods. This may. In turn. Imply the need for 
more, not less, skilled labour and vocational training. Further, given 
technology and output, unskilled and skilled labour appear to be substitutes, 
rather than complements. In the production process. Third, sophisticated 
production function analyses are plagued by statistical and measurement 
problems. If they are not resolved, estimation techniques are unlikely to 
be able to pick up any relationship between trained labour and output among 
firms. However, there are alternatives. Many Input and output measures 
such as performance rating and downtime are available for more modest 
evaluations. 

Training can be evaluated using earnings data or output and Input 
data. In all cases there are technical problems Including sample size, 
control groups, the use of longitudinal data and difficulties caused by 
labour mobility. In the face of such problems with earnings data a simpler 
before/after plant level study of changes In Inputs or output associated 
with training may offer the most tractable evaluation method. 
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La presente etude i) est une enquete partielle des documents relatifs 
k la rentabilite de la formation prr^essionnelle, destinee a tlrer les 
lefpns de 1 'experience, et ii) indique les m^thodes d 'evaluation de la 
formation professionnelle fondees sur les donnees relatives au salaire« a 
la production et aux facteurs de production. 



Selon ses concluaionst troia lemons importantes peuvent etre degagees. 
PreDierement, il semble que les avantages de la formation professionnelle« 
aur le plan social et prive et du point de vue de I'entreprise, soient 
auffisants pour juatifier son developpement. Toutefois, la formation pro- 
diguee dans les institute industriels et les etablissenents secondairea 
d'enseignement profesaionnel est moins rentable qu'une foirmation mains 
structuree, au sein de I'entreprise, du moins dans dea pays tels que le 
Kenya, I'Inde et Israel. D'autre part, selon les donnees recueillies dans 
les pays d'Am^rique latine, 1 'enseignement normal et la formation profea- 
aicnnelle structuree dispensee dans des institutions peuvent se substituer 
l*un a 1 'autre. Deuxiimement , une roethode de production davantage &xee 
aur le recours intensif k la main-d'oeuvre s'avere plus rentable, dans 
certains secteurs, que les methodes actuellement utilisees. De cette 
conclusion il decoule qu'une main-d'oeuvre qualifiee plus abondante est 
necessaire* par consequent que 1 'expansion de la formation professionnelle 
a' impose. Par ailleurs, compte tenu de la technologie et de la production, 
nain-d'oeuvre qualifi^e et non qualifiee semblent interchangeables et non 
pas compl^mentairea dans le processus de production. Troisiemement, les 
analyses approfondies de la fonction de production te heurtent k dea pro- 
blines de stati8ti.ques et de calculs. Si ces problimes ne aont pas r^ao- 
lua, il est peu probable que les methodes d 'evaluation seront k m§me de 
diceler touts relation, quelle qu'elle soit, entre main-d'oeuvre fonnee et 
production, d'une entreprise k 1 'autre. II existe, cependant, d'autres 
aithodes d' evaluation, fondles sur bien d'autres cri tires, notanment per- 
formance et temps d 'arret* dont le champ est plus limits. 

Les donnees relatives aux salaires ou aux facteurs de production et k 
la production peuvent permettre d'evaluer la formation. Dans tous les cas» 
des problimes techniques se pr^sentent, notanment k propos de la taille de 
I'^chantillon, dea groupes de contrdle, de 1 'utilisation de donnees longi- 
tudinales et de la, mobilite de le main-d'oeuvre. C'est pourquoi la compa- 
raison des fluctuations des facteurs de production ou de la production 
d'une entreprise, avee et sans formation, repr^sente peut-£tre la methode 
d'f&valuation la plus facile k appiiquer. 



Extracto 



El presente documento tiene dos finalidades: i) presentar una resena 
parcial de la literatura exlsteate sobre la econonia de la formacion 
profesional a fin de extraer algunas ensenanzas para las evaluaciones, y 
ii) indicar como se pueden llevar a cabo tales evaluaciones usando los 
datos de sueldos, insumos y productos* 

Se ban extraido tres importantes ensenanzas. La pritnera es que la 
rentabilidad social, empresarial y privada de la formaci6n profesional en 
los paises en desarrollo parece ser suf icienteinente elevada para 
justificar la ampliacion de los servicios de capacitaci6n« Sin embargOt 
la formacion impartida en institutos industriales y escuelas tecnicas 
aecundarias es menos eficaz en funcion de los costos que la mas informal 
inpartida en las propias empresas, por lo menos en Kenya, la India e 
Israel. Ademas, los datos de America Latina indican que tal ves haya 
posibilidades de sustitucion entre la instruccidn escolar y la formacion 
profesional formal impartida en instituciones. La segunda es que, en 
algunos sectozes, un metodo de produccion basado en el uso intensivo de 
aano de obra es economicamente mas eficiente que los metodos actuales. 
Esto a su vez significaria que se necesita mas mano de obra calificada y 
formacion profesional, y no menos. Asiroismo, a determinados niveles de 
tecnologia y produccion, la mano de obra no calificada y la calificada al 
parecer se sustituyen entre si en vez de complementarse en el proceso 
productivo* La tercera es que los andlisis complejos de las funciones de 
produccion se ven dificultados por numerosos problemas estadisticos y de 
medici6n« Si estos no se resuelven, no es probable que las tecnicas de 
estimacion permitan determinar la relacion que pueda haber entre el uso de 
aano de obra adiestrada y la produccion de una firma en comparacion con 
otras. Sin embargo, hay otras alternativas. Para las evaluaciones m^s 
modestas se dispone de numerosas formas de medir los insumos y productos, 
como la evaluacion de la eficiencia del desempeno y del ticmpo 
improductivo* 

La eficacia de la <:apacitaci6n se puede evaluar usando datos de las 
renuneraciones o de los insumos y productos* En tcdos loc casos se 
plantean problemas tecnicos, incluidos el del tamaHo de la muestra, los 
grupos de control, el uso de datos longitudinales y las dificultades 
causadas por la movilidad de la mano de obra* Dados los problemas con los 
dates de las remuneraciones, es posible que un estudio mas sencillo, a 
nivel de las fabricas, sobre las vai^iaciones en los insumos o productos 
antes y despues del adiestramiento, constituya el metodo de evaluacidn mas 
factible. 



Summary 



Over a decade ago Nark Blaug - one of the founding fathers of the 
economics of education and training - wrote: "We may as well confess that 
we know almost nothing about the economics of training, its Incidence. Us 
costs and Its benefits." Clearly any economic analysis of training must be 
tentative* but this paper suggests that It Is now possible to say some 
sensible things about the evaluation of training. 

This paper has two purposes. First, a partial review of the literature 
on the economics of vocational training is presented (Sections 2-5). This 
review Is not conducted In a vacuum. It feeds into the second purpose, which 
is to illuminate methods of evaluating vocational training (Sections 6 and 7). 

Vocational skills are Important. Therefore Section 2 examines the 
"where", "when" and "how long" of vocational training. It is possible to 
think of vocational training being located along a continuum. At one 
extreme is secondary school -based training. Next comes training in 
institutions like the vocational secondary school in Urael. Then comes 
the South American type of sandwich training of the SENAI or SENATI variety. 
Finally there is firm-based training. 

It is difficult to generalise on the basis of the studies examined in 
this section because there is no guarantee that the results would be 
replicated over time or across countries. The countries for which LDC 
case studies are available Include: Malaysia. Israel. India. Kenya. Brazil. 



Chile. Colombia and Peru. Nevertheless* some tentative conclusions are 
possible. First, where the rationale for the study was to see if any 
expansion in training facilities was justified th? rate of return was 
typically high enough to justify such an expansion. Second, there is some 
evidence that in Brazil and Peru short courses have a bigger payoff than 
longer courses of training. Third, training in industrial institutes and 
vocational secondary schools is less cost effective than more informal 
firm-based training, at least in Kenya, India and Israel. Fourth, the 
payoff to quasi-institutional vocational training in South America is 
higher for those who have only completed primary school than for those 
who have completed secondary school. This suggests that extra formal 
schooling may be substitutable for formal institutional vocational training. 
For a given length end type of vocational training there are diminishing 
returns to formal schooling. 

Evidence (Section 3) from industrialised countries show that the 
private labour market may fail to provide sufficient trained labour because 
of labour mobility among firms, borrowing difficulties for trainees or 
because trainees' wages are set too high. These factors all provide 
justification for public intervention in the training effort. 

Empirical estimates of the substitution technically possible between 
more skilled and less skilled labour is reviewed In Section 4. The results 
have two important implications for vocational training. First, economically 
efficient production technologies sometimes imply more labour intensive 



technology which* In turn will tend to raise the dcnund for skilled 
labour and In turn, vocational tralnlrig requirements Increase. Second* 
In general* holding output constant* less skilled labour Is* apparently* 
a substitute for skilled labour In the production process rather than a 
complement to It. Indeed* It may well be that the studies surveyed here 
understate the true degree of substltutablllty among different labour types. 
Thus labour Is usually measured according to the occupation-description 
("electrical engineer") rather than what the person actually does 
("maintenance technician"). Training design certainly needs to operate 
on the basis of tasks rather than labels. Although the studies surveyed 
In this section do not relate specifically to the level of the fine 
(typically the data refer to Industries or whole economies) the possibility 
that less skilled labour Is substltutable for more skilled labour* and 
vice versa* needs careful Investigation prior to any evaluation of 
vocational training. 

Firm level training studies (Section 5) are quiite rare but the 
economic analysis they contain Is generally excellent. ^ There are 
several conclusions to note. First* sophisticated production functions 
are unlikely to be able to pick up any relationship between trained 
labour and output at the level of the finn. The main reasons are 

1/ Nucn Norid Bank training is also rlrm-related training so these firm 
Jtudles provide helpful guidance* particularly on the benefits side of the 
training equation. 



statistical: aggregation biases; tneasurement of variables; selectivity 
biases. Second, Individual performance ratings are a sensible and useful 
method of measuring individual productivity, as evidenced by a number of 
successful studies in developing as well as developed countries. Third, 
downtime is a potentially valuable intermediate measurement of output. 
Fourth, although pay is usually a good indicator of the value of a person 
to the firm, it Is not always. Therefore, when training Is being evaluated, 
if pay is used to measure the value of output a cost-benefit framework will 
generally be accuraxe but, on occasion, it may not give correct results. 

Methods of evaluating the external efficiency of vocational training 
using earnings data are discussed in Section 6. This section draws, in 
particular, on the illumination provided by the firm-based studies and the 
extensive literature on the evaluation of public manpower and training 
programmes. Methods and objectives are discussed first. Then various 
technical problems are elaborated, including: sample size, control groups, 
the use of longitudinal data and problems caused by labour mobility. 
Finally, the relationship between pay and the productive value of the 
Individual is analysed. Many factors exist which might drive a wedge 
between earnings and the true worth of the individual to the firm. These 
factors include: union monopoly power, the fact that a skilled person may 
raise the productivity of co-workers, and labour shortages and surpluses. 
Therefore care must be taken when estimating the corporate and social rate 
of return to vocational training. 



The cost-effectiveness of vocational training can also be analysed 
using output and input data (Section 7). A number of promising output 
and input measures exist. For example a before/after study could be based 
on the output of particular individuals using, for example, piece- «ork 
earnings or performance ratings to capture productivity changes &isoc1ated 
with training. Alternativelyt training might be analysed at the plant 
level • using plant downtime or the value of production as the output 
measures or reductions in labour demand and other factors as the Input 
measure associated with training. 



• 



ERIC 



-4 ^ 



Table of Contents 

Introduction and Summery 

Purpose 

Internal efficiency and external efficiency of training 
Manpower requirements compared with rate of return analysis 
Summary 

PART I VOCATIONAL TRAINING IN DEVELOPING AND INDUSTRIAL COUNTRIES, 
SUBSTITUTION AND FIRM-BASED STUDIES 

The payoff to vocational training in developing countries: 

a review of the evidence 

Introduction 

The case for expansion of vocational training 

Cost effectiveness of vocational training 

Social rate of return to different modes of vocational training 

Relationship between formal schooling and vocational training 

The vocational school fallacy 

Summary 

Public training programmes In Industrial countries 

US public training programmes 
Vocational training In Britain 
Summary 

Substitution , , 

Introduction 

Appropriate technology and the demand for skilled labour 
Substitution among different types of skilled labour 
Conclusion 

Firm level studies 

Introduction 
Training costs 

Productivity! output and Input 

Pay, productivity and experience 

Type of training and Job performance/productivity 

Summary 

PART II EXTERNAL EFFICIENCY OF VOCATIONAL TRAINING 

Earnings-based benefit-cost evaluation of vocational training 

Objectives and methods 

Methodological problems: sample size, control groups, longitudinal 

data, labour mobility 
Earnings and output: non-competitive labour markets, externalities, 

disequilibrium 
Summary 

Output-based and other evaluations of vocational training /. 

Methods 

Measures of output 
Benefits and costs 
Summary y o 



SECTION 1 
Introduction and sunwary 



"We (nay as well confess that we know almost nothing about the iconomlcs of 
training, Its incidence, Its costs and Its benefits" (Blaug 1972 p. 199). 

"A recent report by the National Acadeniy of Sciences on the evaluation of 
manpower programs concluded that, after ten years of massive expenditures 
on manpower training programs and many evaluation studies, relatively 
little is known about their Impact. This is a disturbing conclusion to 
have been reached about a program that has commanded a significant share 
of society's resources and has been on-going for more than a decade. 
Nevertheless one of the reasons for the ambiguous nature of the estimated 
Impacts of manpower training programs is that the evaluation of such 
programs presents many difficult conceptual statistical problems that 
have not been well articulated in the literature. These problems arise 
from the difficulties Inherent in analysing and comparing Income streams 
over time for different sets of individuals whose characteristics are 
known only imperfectly". (Cooley, McGuire and Prescott 1979 p. 120). 

If these quotes are accurate (Blaug still believes so more than a 

decade later; any economic analysis of training must be tentative. Certainly 

the material here is put forward in a spirit of caution. However, some 

good studies have appeared in recent years and it is possible to draw some 

lessons from them concerning the evaluation of training. 

1.1 Purpose 

This paper has two purposes . First, a partial review of the literature 
on the economics of vocational training is presented (for an excellent 
previous review, up to 1973, see Zymelman 1976). Special attention Is paid 
to those studies which (1) examine the relative merits of on-the-job versus 
off-the-Job vocational training and the Interaction between formal schooling 
and vocational training in developing and Industrial countries; (11) analyse 
substitution possibilities between capital and labour and between different 



labour types; (111) throw light on the Impact of training costs and on 
output. This partial review Is not conducted In a vacuum. Its aim Is to 
draw lessons concerning the evaluation of the external efficiency of 
vocational training. Thus the second purpose of the paper Is to present 
some Ideas for such an evaluation. 

Training Is like an Iceberg - only part of It Is In view. For example, 
the costs of off-the-job training in institutions are reasonably straight- 
forward to calculate. But much of it Is hidden from view: It is difficult 
to get at the costs and outcomes of things like "sitting next to Nelly", 
the loss cf output attributable to skilled workers who spend some of their 
time traininri less skilled workers, and the value of output produced by the 
trainee. Further, post-training it is divficult to trace output to particular 
individuals. This suggests that case studies using before/after data or 
paired comparisons ("twins") are likely to be the most fruitful method of 
evaluating corporate training. This point may hold with special force for 
training associated with World Bank projects which often Involve output like 
electricity supply, and road miles and port capacity where it would be 
specially difficult to Identify output with any one individual. Even a case 
study Is complicated by the heterogenous nature of such projects. Training 
varies by content, location and duration. Such diversity requires careful 
handling in evaluations. 

Zymelman (1976 pp.9-*ll) provides a comprehensive list of training forms 
(see also Noll en 1983). He points out that there are three basic forms, 
each of which can be sub-divided: 




- training (^n the jobi both formal and informal; 

- training off the job in schoolsi training centres or places of 
worki 

- combined types of training such as apprenticeship with formal 
Instruction off the job, on-the-job training with some related 
instruction* and cooperative-work training. 

The type of training is described with some care when the payoff to vocational 

training In developing countries is analysed. But for the remaining sections 

the particular form of training is less important (for our purposes) - we 

are concerned with gainin,3 insights which are relevant whatever the type of 

training. 

In what follows. Part I presents evidence on three issues relevant to 
the examination of vocational training. These Issues are: the payoff to 
vocational training In developing and industrial countries (Sections 2 and 3 
respectively), substitutability (Section 4) and the methodology of firm-based 
training studies (Section 5). Part II then builds on this partial survey to 
drew some lessons and insights for evaluating the external efficiency of 
vocational training using earnings data (Section 6) or output and related 
data (Section 7). 

1.2 Internal efficiency and ext(?rnal efficiency of training 

The World Bank distinguishes between the internal efficiency of training 
and the external efficiency. Some care is needed here because different 
documents use these terms in slightly different ways. Consider the following 
descriptions or definitions: 
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Internal efficiency 

"... is used here in relation to how economically and successfully the 
trainees are being processed through their training program to its completion** 
(World Bank 1982 p. 19). 

*'The evaluation of the training process ... can be measured by level of 
enrollments! dropout rates, graduation rates, teacher/student ratios, 
recurrent and capital costs per graduate, etc". (World Bank, no date, 
paras. 4.1 and 4.2). 

*'The internal efficiency of an institution is a measure of its health in 
terms of its internal operations. It covers, for example, the effectiveness 
of Its management; the relevance and content of its courses; the quality 
of Its teaching staff; the appropriateness of its equipment and its use; 
the adequacy of acconnodation and its utilisation. It also brings into 
account questions of morale, motivation and staff and student relationships" 
(Hunting, Zymelman and Godfrey 1984, p. 27). 

External efficiency 

*' ... mfers to the extent to which the trained persons proceed to Jobs 
relevant to their training and how well they perform In the light of their 
training" (World Bank 1982, p. 19). 

"The evaluation of results or the impact of training on the production and 
productivity of the utility ... external efficiency could be measured (In 
the power sector) through observation of changes in indicators such as 
(a) production hours, (b) megawatts per worker, (c) gigawatt-hours of 
generated power per worker, (d) maintenance, (e) safety, (f) system losses, 
g) staff turnover, (h) number of consumers/employees, (i) number of cofflp1a1nts» 
j) performance of graduates on the job" (World Bank, no date, paras. 4.1 
and 4.2). 

" ... the external efficiency of the project (is evaluated) by comparing 
costs and outcomes" (Hunting, Z^melman and Godfrey 1984, p. 55). 

There is general agreement that internal efficiency refers to the 
training process '> the identification, preparation and implementation of 
the components of training. To the extent that it has an economic dimension, 
the focus is on costs. The consequences of the training to the Individual, 
the firm or to society do not come Into it. 

There Is less agreement on what constitues evaluation of the external 
efficiency of training. The first description quoted is concerned with a 
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nirrow evaluation of training outcomes. Under this description costs 
are Ignored and the outcome is limited to the kinds of jobs done post training 
and the performance of the trainees In these Jobs. This omits many wider 
considerations. For example, the trainee may raise output among his colleagues 
or may move to another firm and raise output there. The second description 
(taken from the Power Projects Guidelines) presents a very comprehensive menu 
of measures of output, but an evaluation would also need to consider costs. 
The third document defines external efficiency In terms of both costs and 
outcomes. 

The contents of this paper are addressed to the external efficiency of 
training. It is not concerned with the way in which training "needs" are 
identified nor with the process of training. Rather it focusses on costs 
and outcomes, leading up to a discussion of how the externa'i efficiency of 
training con be evaluated. Thus it is orthogonal to the discussion of 
evaluation of internal efficiency in World Bank (1982). The evaluation 
method outlined in Part II is quantitative. However, there are also many 
qualitative dimensions to the external efficiency of training. These are 
well set out in the gestalt approach of Hunting, Zymelman and Godfrey 
(1984, ch.3). But the bottom line of any such evaluation must, if possible, 
be a cost*outcome indicator or a rate of return to training. So the 
dimensions of any qualitative evaluation are Ignored here in an attempt 
to set out some of the Issues when quantitative evaluations are required. 
This paper is therefore complementary to that of Hunting, Zymelman and 
Godfrey (1984). 




No attempt Is made here to set out a formal step-by-step method to 
evaluate* for example, the external efflclenqy of the training component 
In specific projects. (Both Stromsdorfer 1972 and Zymelman 1976 provide 
comprehensive descriptions of evaluation methods and problems). Rather, 
In Part I extant studies are analysed for the insights they provide and 
in Part II various evaluation guidelines are suggested and scrutinised. 

World Bank project related training "seeks to provide specialised 
managerial, technical or operational skills pertaining to a particular 
enterprise or sector. Training by enterprise is restricted to specified 
jobs limited by the future $ca1e of the enterprise and the number of 
employees in only one occupational category during a fixed period of time. 
Because the trainees are also employees, the problem of balancing supply 
and demand does not arise. Further, there can be significant spillovers 
of this training and experience into other activities" (World Bank 1980 
p. 47). In their comprehensive review the Operations Evaluation Department 
recently described PRT as a "traditional and inhibiting view" of the 
"training mandate" (World Bank 1982, para lu). The content of this paper 
is relevant to an;^ evaluation of the external efficiency of training which 
alms to relate costs and outcomes. The analysis holds for sector wide 
training (e.g. the power sector rather than a particular power plant) and 
for vocational training projects such as those being undertaken currently 
by the World Bank in the Philippines and in Indonesia (World Bank, August 1982 
and March 1983 respectively). 

1.3 Manpower requirements compared with rate of return analysis 

This paper is addressed to the ex post evaluation of vocational 
training. As such it does not have to enter the controversy concerning 



ERIC 



7 



the relative merits of the manpower requirements approach and the price 
' theory approach in the analysis of labour market skills (for an excellent 
synthesis see Freeman 1977; see also Psacharopoulos et a1. 1983 for a recent 
examination of manpower planning). Nevertheless, it is worth briefly 
discussing these concepts because this helps to focus the content of the 
paper. 

The manpower requirements approach projects manpower "needs" In any 
period on the basis of the industrial composition of output and employment 
and a fixed skill composition within Industries. It deals exclusively with 
quantitative data, typically at a highly disaggregate occupation or industry 
level. The projected shortages (or surpluses) are identified by comparing 
needs with expected supplies. 

The price theory approach analyses both the demand and the supply side 
of the labour market. On the demand side the key parameter is the elasticity 
of substitution between more and less skilled workers or between capital and 
labour. On the supply side, rates of return are calculated from earnings 
and information on investment in human capital. 

The manpower requirements and rate of return methods can both be used 
to determine the desirable future structure of the labour force, and so 
suggest manpower and training requirements. In this sense they deal with 
one component of the efficiency of vocational training, namely the output 
(quantity and quality of labour) of the training programme compared with 
the ex ante indication of manpower needs (even when determining manpower 
needs alternative indicators are available* such as vacancy rates and 
chanqes in relative wages). 
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However, this paper only addresses itself to the manpower needs question 
in a tangential way, namely when it analyses substitution (Section 4). There 
It is shown, first, that where a more labour intensive technology is more 
efficient than existing technology the absolute number of skilled workers will 
tend to rise , implying a big payoff to vocational training. It Is an open 
question whether production techniques on Bank projects are always appropriate. 
It is possible, for example, that there is little flexibility in production 
techniques in power and water supply but more flexibility in highway construction 
or irrigation technique. A more labour-intensive technology tends to require 
more unskilled and skilled workers. So If there is flexibility in the choice 
of technique this Interacts with the labour supply and, in turn, influences the 
pattern of jobs "needed". Second, given the technology and output there is 
evidence that skilled and less skilled workers are substitutable in the production 
process. Similar evidence would be useful concerning World Bank projects. 
Presumably such substitution possibilities are generally considered to be limited - 
hence the need for vocational training. Putting the point differently: by what 
process is it possible to document so clearly the jobs where training is needed? 

The main thrust of this paper concerns ex post evaluation of the external 
efficiency of vocational training (Sections 6 and 7). Here much of the 
discussion is cast in rate of return terms - a simple way of bringing together 
costs and benefits. This should not necessarily be taken to imply a preference 
for the rate of return approach over the manpower requirements approach when 
determining needs. It is simply that the manpower requirements approach, 
while useful in the ex ante analysis of training, is not relevant to the 
ex post analysis of costs and outcomes. 



1.4 Summary 

Vocational skills are important. The social rates of return to different 
modes of vocational trainin;^ {Ta^ ^ 2.9) are nearly always acceptably high. 
Substitution in production to get the least cost input mix often implies the 
need for mo*^e skilled labour (Section 4). It is not always possible to 
substitute general education for vocational training when producing vocational 
skills. Therefore Section 2 examines the "where", "when" and "how long" of 
vocational training. 

It is possible to think of vocational training being located along a 
continuum. At one extreme is secondary school -based training. Next comes 
training in institutions like the vocational secondary schools In Israel or 
the Indian Training Institutes. Then comes the South American type sandwich 
training of the SENAI or SENATI variety. Finally there is firm-based training, 
including World Bank project related training. It is not possible to generalise 
about the returns to these different forms of training - there are always 
exceptions to any general statement - but the weight of the evidence in Section 
2 suggests that firm-based vocational training has a higher pay off than 
vocational training which mainly takes place in schools. 

When should vocational training occur? There is some evidence that, for 
a given length and type of vocational training, there are diminishing returns 
to formal schooling. This raises the question: should vocational schooling 
come after primary or after secondary school? This issue is discussed in 
Sections 2.5 and 2.6. The major part of the evidence suggests that the 
returns to vocational training are lower for those who have taken secondary 
schooling than those who entered vocational training after primary school. 
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Final the duration of vocational training Is Important. In general 
the evidence In Section 2 Indicates - for Israel and Peru for example - 
that short courses of vocational training have higher returns than longer 
courses. 

Industrialised countries use resources equivalent to around 3 per cent 
of GOP on training. There are a large number of evaluations of training In 
such countries, particularly that provided or financed publicly. Some 
recent evidence Is discussed In Section 3. It Is shown that the private 
labour market may fail to provide an efficient supply of trained labour 
because of poachiiig, borrowing difficulties for trainees or because trainees 
wages are set too high. This provides a reason for public Intervention in 
the training effort. In addition public provision of training is sometimes 
justified on equity grounds, to Improve the lifetime chances of those towards 
the bottom of the occupational hierarchy. Most evaluations use information 
on earnings to get at the costs and benefits of training. Evidence suggests 
that the best such evaluations have data on both trainees and a control group 
of non- trainees and on earnings before and after training. 

Substitutability is discussed in Section 4. The evidence presented is 
not relevant to any immediate evaluation of vocational training in a particular 
plant. Rather it is relevant at one remove: care should be taken both with 
the choice of technology and with the mix of labour employed to produce a 
given output from given equipment. Two points stand out. First, in some 
sectors a more labour-intensive method of production is economically more 
efficient than current methods. This may, in turn, imply the need for more, 
not less, skilled labour and vocational training. Second, if the technology 
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and output are taken as given the bulk of studies show that more and less 
skilled labour are substitutes, rather than complements In the production 
process. It would be Illuminating to know If this Is also true In the 
particular plants where training associated with Bank projects takes place. 

Firm-level (Section 5) training studies are quite rare, but the 
economic analysis they contain Is, In general, outstanding. Much World 
Bank training Is also firm-related training so these firm studies provide 
particularly helpful guidance. On the cost side It Is clear that the costs 
of Informal training are difficult to get at, while foregone earnings and 
the resources devoted by the firm to formal training are more easily estimated. 
But It Is on the benefits side that the real Insights are gained. First, 
sophisticated production functions are unlikely to be able to pick up any 
relationship between trained labour and output at the level of the firm. 
Second, performance ratings are a sensible and useful method of measuring 
(Individual) productivity and would be helpful In cost effectiveness studies 
of World Bank training expenditure. Third, downtime Is a potentially valuable 
Intermediate measure of output. Fourth, and most Important, pay may well be 
an Imperfect Indicator of value product. In particular pay rises with experience 
but productivity may not. Therefore If we use pay to measure the value of 
output a cost-benefit framework may not always give correct results. 

It Is noteworthy that firm-level studies typically concentrate on either 
costs or outcomes but do not analyse both simultaneously in the form of cost- 
benefit analysis. (By contrast, rate of return studies abound for public 
training programmes). There are a number of reasons why there are few rate 
of return studies to corporate training. First, training is not usually a 
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separate entity which must show a profit. Second. It Is difficult to dis- 
aggregate training from other things that go on Inside a company - training 
Is part of a whole bundle of things that go on together. Third, It Is very 
difficult to test for the notion of specific training, where training Is only 
useful In the firm providing It. Firm specific training is tied up with 
Implicit contracts and monopsony power. Much firm-level training (either on- 
ihe-job or off-the-job in the firm or in institutions) is concerned with 
encouraging loyalty and the promotion of an internal labour market. It is 
plausible that such company training is simply not testable in standard cost- 
benefit terms. In particular, is it really possible to estimate the wedge 
between value product and pay? 

Despite such problems Part 11 concerns methods to evaluate the external 
efficiency of vocational training. In Section 6 we discuss how to evaluate 
such training using earnings data and the problems which occur. This section 
draws. In particular, on the illumination provided by the firm-based studies 
and the extensive literature on the evaluation of public manpower and training 
programmes. Methods and objectives are discussed first. Then various 
technical problems are elaborated, including: sample size, control groups, 
the use of longitudinal data and problems caused by labour mobility. Finally 
the relationship between earnings and value product is extensively analysed. 
In general non-competitive labour markets, externalities and disequilibrium 
drive a wedge between earnings and the true worth of the Individual to the 
firm so great care must be taken when evaluating the corporate and social 
rate of return to vocational training. 
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Section 7 discusses cost-effective and cost-benefit analyses of 
vocational training using output and Input data. A number of promising 
output and input measures exist. For example a before/after study could 
be based on the output of particular Individuals and use piece-work 
earnings, performance rating or quit propensity as the Indicator of 
output. Or training might be analysed at the plant level using plant 
downtime or the value of production as the output measures or reductions 
in labour and other factors as the Input measure associated with training. 
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PART I 

VOCATIONAL TRAINING IN DEVELOPING AND INDUSTRIAL COUNTRIES. 
SUBSTITUTION AND FIRM BASED ^lES 



SECTION 2 

The Payoff to Vocational Training In Developing Countries; 

A Review of the Evidence 

2.1 Introduction 

A limited number of studies have examined the rate of return to vocational 
training in developing countries. A number of overlapping but different themes 
are apparent in the partial survey which follows. These include: 

- the case for expansion of the system of vocational training or 
particular parts of that system, 

- the internal efficiency or cost effectiveness of the system, for 
example between different types of courses or different length courses » 

- comparisons of the payoff to on the job training and off the job 
training, though "on" and "off" need careful definition, 

- the substitutabiHty between vocational training and formal schoolings 

- the vocational school fallacy. 

These themes wi11 be examined one at a time below. 

The studies run up against many technical problems of evaluation* particularly, 
on the benefits side. These problems include: 

- the type of control group: fu11 longitudinal data are helpful because 
we are then dealing with the same individuals before and after training. 
Where we only have cross section data the control variables may be 
crucial , 

- the measurement of earnings is important on both the cost and benefit 
side, for example: do earnings reflect productivity, what do we do 
about intangibles, is the labour market in equilibrium, what Is the 
shadow price of labour? 

- mobility of individuals among firms, occupations and countries influences 
the various rate of return calculations to individuals, firms and soc1ety» 
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- Is It possible for a firm to drive a wedge between pay and productivity 
for long periods? This Is particularly Important In calculating the 
rate of return for the firm, 

- the need to correct cost and benefit figures for drop-outs, 

- the extent to which wider labour market analysis - "/f vacancy rates 
and earnings changes for example - Is useful to supplement the rate of 
return analysis. 

Such methodological problems will only be briefly examined here, but they are 
more fully discussed In Part II. 

To set the scene the results of the various studies are summarised In 
Tables 2.1 and 2.2. In Malaysia Cohen (1983) examined three types of training - 
two year basic, job entry training for new recruits and apprenticeships - 
which all apparently yield a high rate of return, of the order of 20 per cent. 
Borus (1977) was partlcuarly interested In the cost effectiveness of four 
different modes of vocational training in Israel. He concluded that the 
different modes yield the same earnings even though they have very different 
costs. In particular he questioned the cost effectiveness of formal vocational 
secondary schools. However, his results have been qualified somewhat by Levine 
(1979). 

Two studies which do not measure productivity by earnings are those of 
Fuller (1976) and Godfrey (1977). Fuller finds that productivity in his Indian 
case study firm is raised more by in-firm training than by pre-employment 
vocational training institutes. His study is unusual because productivity is 
measured by a cardinal scale of worker efficiency ratings. In a rare study 
relating to Africa Godfrey (1977) examines whether the likelihood of passing 
a government trade test (at three different levels) of craft skills is related 
to institutional training, after controlling for schooling and age. He finds 
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Payoff to vocational training In South America 



Country/ 
author 
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those with some fu11 time Institutional training have lower pass-rates than 
those with no such training. Both these studies cast doubt on the payoff 
to institutional vocational training even though they do not calculate social 
or private rates of return. 

The payoff to vocational training in South America Is summarised in 
Table 2.2. The systems In the countries described In the table seem quite 
similar. The training organisations are semi -autonomous. They are financed 
by a payroll tax on private firms above a certain size and on all public 
organisations. The system Is separate from the formal education system and 
consists mainly of vocational schools or In-plant but off the job training. 
The ILO provides teci.nlcal assistance. 

In Brazil postgraduate SENAI training yields a minimum social rate of 
return of 12 per cent (Castro, 1979). One of the earliest internal World Bank 
rate of return studies showed a social rate of return to the INACAP training 
system In Chile as high a.' 50 per cent, but various qualifications by 
Arrlazazzl (1972) cut that exceptionally high figure by over half to some 
20 per cent. For Colombia Puryear (1979) shows that Individuals who have 
taken a three year SENA apprenticeship earn, on average, nearly half as much 
again as similar Individuals who have not been exposed to SENA, and the SENA- 
effect Is bigger for those with less formal education than those with more 
eduatlon. These studies of training In Brazil, Chile and Colombia all show a 
rather high payoff to vocational training, but the opposite conclusion was 
reached by Psacharopoulos (1982) In the analysis of SENATI training In Peru. 
There were no data to calculate a rate of return, therefore the author 
Inverted the problem and calculated the pay differential trainees would 

ERIC 31 
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require to generate a 10 per cent social return. Individuals trained under 
two year apprenticeships would require, post training, a positive differential 
over 70 per cent above the minimum wage and the study questions whether this 
would be forthcoming, although it is more sanguine about the prospects for 
shorter courses. 

2.2 The case f or expansion of vocational training 

The World Bank has undertaken studies designed to see whether the whole 
system of vocational training should be expanded in a particular country and 
whether particular components should be expanded faster than others. 

Twenty years ago a lucid Bank study (Picclotto 1965) examined the case 
for large-scale expansion of vocational training to be undertaken by the 
National Training Institute (INACAP) in Chile. The project concerned three 
specific INACAP programmes (Arriagazzi, 1972): 

- Basic training courses to upgrade unskilled into semi-skilled workers. 
These full-time courses lasted three to six months and covered a 
variety of trades. They were designed especially for: youngsters 
Who had reached a prescribed minimum of general education but with no 
technical training, unemployed people, employed workers wishing to 
Change Jobs or to migrate to another area. 

- Further training courses to upgrade semi-skilled workers to skilled 
status. These evening courses, lasting from ten to twenty weeks 
covered a variety of trades and were intended mainly for experienced 
workers with daytime jobs. 

- Specialisation courses to provide experienced skilled workers with more 
advanced special skills. These evening courses lasted from five to 
fifteen weeks. 

In 1965 some 12,000 trainees had completed these INACAP programmes. The proposed 
target was to expand the annual output of the three programmes by an . Jitlonal 
14.000 trainees. The Bank estimated the project costs - capital, current. ILO 
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technlcal assistance and students' foregone earnings. Benefits were defined 
as the total extra gross earnings the 14,300 trainees could expect to receive 
on completion of their period of training adjusted downwards, In aggregate, 
arbitrarily by one third to allow for the fact that a fraction of the employees 
might, In time, have acquired equal proficiency simply with experience. The 
Internal rate of return on the project was put at 50 per cent, providing "ample 
economic Justification for undertaking the project" (p. 4). The costs and 
benefits of this project were re-calculated by Arrlagazzi (1972). The revised 
costs changed little but more conservative figures were used for benefits. 
The 1965 study had assumed that: 

- all trainees would complete their course, 

- all trainees would get promoted accordingly, 

- following training, Individuals would be fully employed for twenty years, 

- each worker's Increased earnings would begin as soon as the second year 
after his training, 

- the present value of earnings should be reduced by one sixth to allow 
for a reduction In the work week from six to five days, 

- the present value of earnings should also be reduced by one sixth to 
allow for the fact that some trained workers would eventually acquire 
similar skills via experience. 

More realistic assumptions cut the social rate of return to around 20 per cent, 

still "strikingly high" (p. 358). 

The economic Justification of expanding vocational training facilities In 

Peru has recently been analysed by Psacharopoulos (1982). SENATI Is the national 

centre for Industrial training, financed by a 1.5 per cent payroll levy of 
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firms employing more than 15 employees. Essentially It runs two types of 
programmes : 

- long term apprenticeships (about two years duration) offered to youths 
with secondary school background via full-time SENATI based Instruction 

- short term upgrading courses (of a few weeks duration) offered to adult 
employed workers by means of a visiting Instructor In the firms. 

No full data on earnings of SENATI graduates and others exist and so rate of 

return calculations were not possible. Therefore the problem was Inverted 

and the earnings differential due to SENATI training required to produce a 

social rate of return of 10 per cent was estimated. The earnings differential 

is arrived at by solving the short cut rate of return formula for the numerator 

of the expression: 

Required earnings differential , 
Training cost (« unit cost plus foregone earnings) ' 

The results are given In Table 2.3. As the study remarks, there is a "dramatic 
difference ... between apprenticeship and other programmes offered by SENATI. 
Productivity differentials equivalent to 0.3 to 5.0 per cent of the minimum 
wage rate can be reasonably assumed to exist for short term programmes like 
In-Service Upgrading and Training within Industry. The 50,353 sales monthly 
differential associated with apprenticeship is rather unlikely to exist in 
practice". Therefore the study, conservatively, reconmends that in any 
expansion of the SENATI system priority should be given to the shorter courses. 

The World Bank has recently also examined the cost for expanded in-service 
Industrial training in Malaysia (Cohen 1983). Malaysia lags significantly 
behind other major Asian countries in terms of technical/vocational school 
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TABLE 2»3 
SENATI programme in Peru 



ijr|^ ui pi vy roiiRiiB 


1 

Unit cost per 
1982 soles 


Monthly productivity (earnings) 
differential to yield 10 per cent 
social rate of return 


in absolute 
1982 soles 


as per cent of the 
minimum wage rate 


Apprenticeships 


4,362,400 


50,353 


71.9 


In-service upgrading (PTS) 


36,000 


320 


0.5 


Training within industry (ADE) 


127,400 


1,058 


1.5 


Support to small industry 


193,700 


1,614 


2.3 


Mobile units 


273,900 


2,283 


3.3 


Instructor training 


429,800 


3,582 


5.1 


Tele-education 


22,500 


188 


0.3 



Source: Psacharopoulos (1982), Tables 2.2, 2.3. 

Notes: Unit costs Include direct costs and administrative expenditures. It has- 
been assumed that apprenticeships last two years and Instructor training 
one year. Foregone earnings are not given, but it Is straightforward to 
calculate them from the formula given on page 21. 
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enrollment as a percentage of total school enrollment (Malaysia - 11 per cent. 
Republic of Korea - 50 per cent, Thailand - 26 per cent). The study indicates 
that "rapid industrialisation over the past decade has not been matched by the 
necessary restructuring of the education system to increase emphasis on 
technical and vocational training. The shortfall in this type of training 
may, however, be too large to be resolved solely by the expansion of 
institutional training. Although institutional training Is Indispensable 
In the longer run, training -by industry will have to play a greater role in 
reducing the imbalance In the short term" (p.l). 

The sample was drawn from ten companies, ranging in size from 340 to 
4,300 workers. About 17 per cent of the total workers in the ten companies 
were undergoing various types of training. Of these about 96 per cent were 
enrolled In in-house training and the remainder in out-of-house training. 
There are four types of training: 

- basic training for new recruits for about two years partly on the 
job and partly off the job, equivalent to apprenticeship training, 

- job entry training for new recruits on probation for a shorter period, 
usually six months, 

- refresher courses for the company personnel lasting from a few days 
to a few weeks. Pay in not affected, 

- upgrading courses for company personnel for a few weeks, partly on 
and off the job. On completion their salary is rescaled. 

The study concentrates on the first two types of training and It also presents 

'comparisons of the payoff to on-the-job and off-the-job training. 

Returns to the Individual, the firm and society from basic skill training 

are given In Table 2.4. The relevant formulae for calculating the rates 

of return are discussed in Section 5. The private and social returns 
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TABLE 2.4 

Returns to basic skill training, Malaysia, 1982 



Sector 


Rate of return {%) to: 


Firm 


Wo rke r 


Society 


nexai proQUCuS 


29 




28 




29 


Non-electric machinery 












Firm A 


13 




29 




14 


Firm B 


22 




24 




22 


Firm C 


25 




25 




35 


Average 


22 




27 




25 



Source: Cohen (1983), Tables 2.4, 2.6, 2.7. 
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are well known. The rate of return to the firm Is a less widely used notion. 
The costs to the firm are: cost of training plus earnings of trainee minus 
the productive value of the trainee. The benefits to the firm are: the 
productive value of the worker minus the earnings paid to the worker* all 
multiplied by the retention rate of trained workers. The rates of return set 
out In Table 2.4 suggest that this is an attractive Investment from each of 
the three different perspectives. Likewise, the rate of return to the firm 
from job entry training averages 46 per cent. However, these results should 
be treated cautiously. A before/after methodology was used. Although this 
is Ingenious It Is also worrying because the study simply constructs the 
required longitudinal data. In particular. It assumes that the productive 
value of the worker post training Is equivalent to the average earnings of a 
trained worker but that actual earnings are below average earnings for twenty 
years post training. This "automatically" produces a high rate of return to 
the firm and to society. This problem is discussed further below (Section 6) 
but It Is worth remarking here that It Is not clear how the firm Is able to 
pay the trained worker below his true worth for as long as twenty years. 

For apprenticeship training the study Is able to estimate and compare 
returns to institutional training (IT) and firm training (FT). The main 
differences between them are: 

- the firm gives a premium of 12 per cent higher pay to an IT trained 
apprentice, largely attributable to his additional productive capability 
over company workers, 

- the retention rate of IT graduates is 10 per cent below FT workers, 

- the production during training is lower among trainees from IT than 
among company trainees « by about 25 per cent, 

- the training costs of IT are higher than those of FT. The average unit 
cost for IT is M$ 7,570, compared to M$ 5,200 for the cost of FT. - 



26 



Ths resulting rates of return are as follows {%): 



Firm Training 
Institutional Training 



Individual 
15 
IS 



Firm 
21 
60 



Society 
21 
19 



The economic return Is again very high, suggesting the proposed expansion of 
vocational training Is sensible. The payoff to the firm Is higher from 
recruiting an IT worker than from undertaking Its own training. This Is 
because the firm does not bear the cost of IT and hints that a levy/grant 
system might help equalise the FT and IT returns to the firm. 
2.3 Cost effectiveness of vocational training 

Vocational secondary school programmes are costly, therefore we must ask 
"Does vocational schooling result In sufficiently superior job performance 
and earnings to justify the extra cost?" (Staley, 1971). Studies which 
confront this cost-effecciveness question Include those for Israel (Borus» 
1977) and India (Fuller, 1976). The economic returns in the early 1970s 
associated with the costs of four different types of vocational training In 
Israel - vocational secondary schools, industrial schools, apprenticeships 
and short courses - are examined. The results of Borus' study have been 
scrutinised by Levine (1979). The vocational progranimes in Israel were 
described by Borus as follows in 1972-3: 

Apprenticeships 

The apprenticeship programme had 8,600 enrol lees. The majority were 
for three years. Typically apprentices came from low socio-economic 
backgrounds. The apprentices work five days a week with employers providing 
on-the-job training and they attend school one day a week to learn the theory 
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of their trade. Apprentices were examined at the end of each year and had 
to pass an examination before receiving Ministry of Labour certification 
necessary to work In their trade. 
Industrial schools 

Some 1,800 students attended about thirty industrial schools In 1972-73. 
These schools, operated in co-operation with and at the site of large 
employers of skilled labour, combined regular vocational secondary school 
training with in-plant training. The courses typically last three years. 
At the end of their training the students were examined and certified in 
their trades by the Ministry of Labour. 
Ministry of Labour "short" courses for youth 

Some 2.100 16- and 17-year olds participated in short courses sponsored 
by the Ministry of Labour. Many of these were preludes to further training 
or work within the Army and usually lasted for one year. Most of the time 
was devoted to providing practical experience in the trade. At the end of 
their courses the students were tested and certified in their trades by the 
Ministry of Labour, 
Vocational secondary schools 

Some 70.000 students, or 50 per cent of secondary school students, 
attended vocational secondary schools. These schools were highly selective, 
admitting only the better primary school students. Approximately half the 
week was devoted to general studies and half to practical training in 
vocational subjects. 

The data for the study refer to the 1969 and 1970 earnings of 530 
individuals born in 1947 who were trained in one of the three occupations - 
automobile mechanics, electrician trades, metal working trades. Earnings 
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were regressed on type of vocational training, sector and Ininl grant status. 
Some results are given In Table 2.5. There are no significant differences 
In earnings among the four training modes or, as Borus puts It "the different 
modes of training yielded approximately equal products" (p. 9). However the 
training costs are very different. Table 2.6 indicates that the cost per 
student is five times higher for Inuustrial Schools and Short Courses than 
for Apprenticeships and that Vocational Secondary Schools arc nine times as 
costly as Apprenticeships. 

These findings suggest that, focussing on skills training, the formal 
vocational secondary schools, are much less cost effective than other methods 
of training skilled and semi-skilled workers, particularly apprenticeships. 
However, Levlne (1979) suggests that these results must be qualified. He 
points out that, in general, individuals with the most years of formal 
education also undertake more on the Job training than other workers. Borus 
is observing earnings only a few years after one or other of the training 
modes. Thus, while the earnings for the 1947 cohort from the four training 
modes are not significantly different from one another In 1969 or 1970 the 
present values could be different if we had more complete data on longitudinal 
earnings, because those going to vocational secondary schools may have steeper 
age-earnings profiles. Levlne re-works Borus' data using plausible 
assumptions about (1) the fraction of potential earnings Invested In each 
period, and (11) the return on that Investment. In turn, this permits a rate 
* of return calculation to the extra Investment in vocational secondary schools 
over and above the other training modes. The results are given in Table 2.7. 
It seems clear that the payoff to the extra resources devoted to vocational 
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TABLE 2.5 

Regression of 1969 and 1970 earnings (in Israeli Lirot) on four training modes 

by occupation and immigrant status (n 



Independent 
variables 


Sample 
distribution 


1969 Earnings 
regression 
coefficient 


1970 Earnings 
regression 
coefficient 


Constant 




5471 




Metal 








Industrial school 
Vocational secondary 
school 


.03 
.18 


1290 
-39 


1479 
-74 


Electrical 








Apprenticeship 
Vocational secondary 
school 


.05 
.16 


-1934 
-259 


-521 
-833 


Automobi le 








Apprenticeship 
Short course 
Vocational secondary 
school 


.14 
.04 

.03 


-105 
-334 

-1744 


-374 
-351 

-188 


Immigrant 


.64 


-19 


-197 



Source: Borus (1977) 

Notes: (i) All coefficients non-significant at 5%\ « .00. 

(11) Intercept value: Israeli born apprentices In metal trades. 
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TABLE 2.6 

Approximate average cost Mn Israeli Li rot) per student enrolled in 
various types of vocational training in 197Z-/3 



Cost 


Apprenticeship 
(3 year) 


Industrial 
school 
(3 year) 


Short 
course 
(1 year) 


Vocational 
secondary 
school 
year; 


Instruction, administration, 
equipment, building 


3075 


9250 


3825 


11050 


Student opportunity cost 


0 


7575 


11775 


15700 


Total cost per student 


3075 


16825 


15600 


26750 



Source: Borus (1977) ^ 



TABLE 2.7 

Estimated rate of return in Israel to investment in vocatio'^al secondary schools, 

over and above other training modes listed 



Comparison Group 


Return to vocational 


secondary schools (X) 


Social rate of return 


Private rate of return 


Minimum 


Maximum 


Minimum 


Maximum 


Apprenticeship 


0 


5 


0 


5 


Industrial school 


2 


14 


0 


n 


Short course 


1 


12 


4 


21 



Source: Levine (1979) 
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secondary schools over apprenticeships is not worthwhile for individuals 
or for society (from the perspective of ski 11 -training) but it just might 
be as compared with the Industrial School and Short Course mode. 

Recently Ziderman (nd) has up-dated the work of Borus and Levine using 
individual earnings data for the 7-year period 1969-75 for two samples. 
One sample consisted of some 300 graduates of Ministry of Labour vocational 
courses for adults, and the other of 1,500 skilled workers who received their 
training as teenagers either at vocational secondary schools or at industrial 
schools, short annual teenager courses or apprenticeships. The samples were 
standardised by age, location and background data on the individuals. 
Ziderman found no significant differences in the earnings of graduates of 
the four types of courses. This confirms the earlier results of Borus 
relating to a much shorter post-training earnings follow-up. They also 
confirm the Borus-Levine results that the expensive vocational secondary 
schools offer no earnings advantage, even in the longer term, over cheaper 
job-related training programmes. Ziderman concludes "Here it would seem is 
yet a further instance of the vocational schooling fallacy" (p. 135). Ziderman 
also found that workers undergoing training in their early and mid twenties 
may expect a higher lifetime earnings profile than teenage trainees, a result 
of the benefits stemming from the continuity of study and work experience 
uninterrupted by amy service and also a reflection of the better career 
choices made at a more mature age. 

Fuller (1976) studies the cost-effectiveness of different types of 
vocational training in one large plant in southern India. His productivity 
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measure was the job ptrfonnance, as assessed by their supervisors, of 474 
millers, turners and grinders. The advantage of using efficiency rating 
is that "they are related specifically to a worker's individual output 
(quality and quantity) and already take into account extraneous factors 
affecting worker performance such as machine capacity, flow of materials 
from co-workers, case of access to tools and instruments, and hardness of 
raw materials" (p.31). 

There were three mutually exclusive training paths: 

- Industrial Training Institutes (ITI), an eighteen month government 
sponsored vocational programme for boys with some secondary 
schooling, sometimes followed by one year pre-employment apprentice 
ship training (n « 214), 

- In-Finu Training (IFT), any organised training programme operated 
within the company for employed workers (n ■ 227), 

- Picking Up Trade (PUT), where unskilled workers acquire job know- 
how by imitations, co-workers and supervisors (n » 33). 

Control variables included schooling, experience, caste, religion and job 

satisfaction. The benefits and costs of the three types of vocational 

training are given in Table 2.8. For the whole sample job performance is 

around ten per cent higher among those formally or informally trained in- 

plant than in the Industrial Training Institutes. Yet the costs of 

institutional training are much higher. Clearly, in the case of this 

particular firm at least, the Industrial Training Institutes are not cost 

effective. 
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TABLE 2.8 

Benefits and costs associated with three modes of vocational training 

in one plant in southern India 



Type of 
training 


Costs 
discounted 

at S% 
(rupees) 


Costs 
discounted 

at S% 
(rupees) 


Job performance % 
over pre-employment 


All 
sample 


MtdlM 
cdMatlon 


High 
education 


Pre-employment 


7580 


6824 


m 


m 


• * 


Organized In-firm 


4550 


4345 


9 


8 


6 


Informal in-firm 


0 


0 


10 


0 


19 



Source: Fuller (1976), Tables 3, 4, 5. 
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2.4 Social rate of return to different modes of vocational training 

Naturally it is Interesting to widen the cost-effectiveness question 
and to enquire whether a particular mode of vocational training has a 
consistently higher payoff than another mode. Some such comparisons are 
presented, tentatively, in Table 2.9. Most of the studies surveyed are 
surprisingly vague on the precise nature of the vocational training they 
are analysing, therefore the classification is speculative. The table 
suggests the following points. 

First, of the thirteen country /mode cjlls in the table nine seem to have 
acceptably high social rates of return. The exceptions are: (1) SENATI 
apprenticeships in Peru; (11) Vocational Secondary Schools in Israel if they 
were to yield only the minimum rate of return; (ill) Industrial Training 
Institutes In India, and (iv) Full time Institutional craft training in 
Kenya . 

Second, on the costs side, when we compare different modes of training 
inside a given country the social rate of return is higher where training 
expenditures are low and where foregone earnings are small or zero. 
(Although this is not surprising It need not be so). For example in Israel 
In-plant apprenticeship training has a higher payoff than formal vocational 
secondary school training. An In Brazil and Peru short in-plant training 
has a larger social rate of return than Institutional training done through 
SENAI and INACAP (thou^ii we should, presumably, treat some of the Brazilian 
* estimates of rate of return to in-plant training rather cautiously). In 
India the Industrial Training Institutes have substantially higher costs, 
and a lower Impact on productivity, than in-firm t.aining. Such cost 
differentials bring out the Importance of the internal efficiency of training. 



TABLE 2.9 

Social rate of return (%) to different modes of vocational training 



Country 


Apprenticeships 
cliSsroM end 
on- the* J Ob 


Institutional 


ln*-pUnt workshop 
but not on-the-job 


On-the-job 
I.e. production process 


ASIA/AFRICA 










Malaysia 

(Cohen 1983) 


2 year besic skill 
tril fling 


For apprenticeship 
19 








21-2S 






(Lcvtne 1979) 

i 
1 

1 

i 




To Vocational secondary 
schools cf , 

apprenticeship O-S 
Industrial school 2-^ 
short courses 1-12 






Indli 

(Fuller 1976) 




Productivity 91 worse 
than In-flm training 
and costs higher 


Productivity 9t better 
than Instltutlonil and 
costs lower 


Productivity 101 better 
than Institutional and 
costs xero 


Kenyi 

(Godfrey 1977) 




Uss likely to 
pass govemiaent craft 
test than those with 
no such training 






SOUTH MCRICA 










Peru 

(Fs«chiropou1os 1982) 


2 year SENATI 
low return 




Short SENATI courses 
high return 


Chile 




INACAP MX 6 Months 
20 




ColcMbta 
(Pufyear 1979) 


J yeer SCNA earnings 
effect 

48 

N J. NOT social rate 
of return 
















•ratU 

(Castro 1979) 




SENAI over primry 
39 


SENAI or own flni over 
prlMiy and junior high 








243 




0 

ERLC 




48 
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In Kenya government trade tests are conducted In many craft trades. 
Including engineering, woodwork, building, electrical trades, tailoring 
trades. There are three grades of trade test. It Is possible to prepare 
for the test by attending a full time course at a training Institution. In 
Godfrey's analysis of the pass/fall rates In these tests 141 out of 446 
candidates had attended such a full time course, at Institutions ranging 
from village polytechnics and youth centres at one extreme to the Kenya 
Polytechnic at the other. After controlling for schooling and age those 
who have followed such Institutional vocational training are significantly 
less likely to pass the trade test than those without training: those 
taking the (easiest) Grade III test are 14 per cent less likely to pass and 
those sitting the (hardest) Grade I test are 25 per cent less likely to 
pass. This raises serious doubts about the social rate of return to such 
institutional training In Kenya. 

Third, one country where explicit comparisons of different modes of 
training were made was Malaysia. Apprenticeship training via a mixture of 
on-the-job training and classroom training has a somewhat higher social 
return than purely Institutional apprenticeship training. 

Last, but not least, wherever comparisons are possible within a country 
we note that Institutional vocational training always has a lower payoff 
than training done wholly or partly inside the firm, whether on or off the 
job. 



-37- 

2.5 Relationship between formal schooling and vocational training 

Two of the studies of vocational training In South America have examined 
the relationship between formal schooling and vocational training. Puryear 
(1979) estimated the payoff to three year SENA apprenticeships in Colombia. 
His sample consisted of all males who had graduated from the SENA industrial 
apprenticeship programme in Bogota between 1965 and 1967 and, essentially, a 
control group of Bogota men similar to the SENA apprentices in age and formal 
education. He regressed the hourly earnings of his sample in 1972 (i.e. five 
to seven years after training) on: whether a SENA graduate, years of formal 
schooling (squared), years of work experience, firm size, father's socio- 
economic status. SENA graduates earn, over the sample as a whole, 48 per 
cent more than equivalent non-SENA graduates, but this "SENA effect" is 
smaller for those with more than six years education. Those with only 
primary school education gain 76 per cent in hourly earnings if they are a 
SENA graduate, while those with ten or eleven years formal education gain only 
33 per cent (Table 2.10). Puryear notes that this implies SENA can sui)st1tute 
for formal education. We can make this more concrete as follows. The 
coefficient on years of formal schooling (squared) is 0.005, therefore SENA 
graduates with eleven years formal education get only 5 per cent more 
earnings than those with five years.: 



• 


Individual with 
5 years education 


Individual with 
11 years education 


Gain associated 
with extra years 
of education 


SENA 


.760 


.330 


-.430 


Formal education 


.125 9 


.605 , 


4.480 




(• .005 X 5^) 


(• .005 X ir) 










NET +.050 
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TABLE 2.10 

Ifwpact of SENA on hourly earnings in Colofflbia. 1972. by years of education 



Years of formal education 


All sample 


5. 6 


7, 8, 9 


10, 11 


3 year SENA apprentice graduate, 
impact on hourly earnings {%) 


48 


76 


29 


33 



Source: Puryear (1979). Tables 1 and 2. 
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Such a result confirms Puryear's observation that SENA can substitute for 
extra years of formal education. 

In his analysis of SENAI vocational education in Brazil. Castro (1979) 
comes to a rather similar conclusion. He calculated rates of return for 
manual workers with various combinations of education and training in the 
manufacturing sector in Sao Paulo and Rio de Janeiro. The results for Sao 
Paulo are reported In Table 2.11. The social rate of return to the SENAI 
programme is higher (24 per cent on average) for those with only primary 
education than those with Junior high school education (12 per cent on 
average). Likewise the social return In both Rio de Janeiro and in Sao 
Paulo to those going on to four years of Junior high school after primary 
Is only half that (12 per cent) of those who Instead go on to the SENAI 
programme (24 per cent). 

Formal education and vocational training each sep&rately add to earnings 
In Brazil and Colombia. The social returns to extra formal education appear 
high in both countries: the return to high school in Brazil is twice the 
return to Junior high school, and in Colombia years of education are associated 
with earnings not linearly but quadratically. However, for our purposes che 
dominant result is the very high payoff to quasi-institutional vocational 
training for those who have only completed primary school, which suggests 
that such vocational training may be substitutable for extra formal schooling. 

Fuller's (1976) case study from India also distinguishes various 
Combinations of schooling and training. Irrespective of schooling level workers 
formally trained in-firm perform better than those trained in the vocational 
Institute. For those who picked up the trade informally the productivity 
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TABLE 2.11 



Social rates of return by type of vocational training 
and level of acaoemic scnooting. sao Faulo i97u 



Level and type of education 



1. Junior high school after primary school 

2. High school after junior high school 

3. Technical high school after junior high school 

Draughtsman 
Electricity 
Electronics 
flechanics 
Metallurgy 
uiemistry 

4. SENAI after primary school (4 to 6 years) 

Draughtsman 
Electricity 
Electronics 
Tool and die making 
Mechanics 
Metallurgy 

5. SENAI after junior high school 

Mechanics 

Production control etc. 
Research and development etc. 

6. SENAI after high school 

Mechanics 

Production control etc. 
Research and development etc. 



12 
30 
0 
31 
9 
9 



9 

37 
18 
46 
33 
24 



26 
8 
29 



39 
20 
43 



Social 
rate of return % 



12 
23 
13 



24 



12 



23 



Source: Castro Moura (1979), Table 1. 
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effect, rei stive to Institutional training, only occurs for those with high 
levels of schooling suggesting extra schooling may be a pre-requlslte for 
on-the-job training. 
2.6 The "vocational school fallacy" 

The studies discussed above provide some evidence on the so- 
called "vocational school fallacy" Foster, 1966). Different authors 
Interpret this fallacy In different ways. One strand is to examine the 
returns to vocational training in institutions as compared with that on or 
off the job In firms. Another concerns the relative merits of vocational 
training in institutions compared with longer academic schooling coupled 
with on-the-job training. 

In South America the returns to the various institutional training 
Agencies in Chile, Colombia and Brazil suggest that the vocational schools 
there are cost effective particularly for those with relatively low levels 
of formal primary and/or secondary schooling. Thus Castro describes the 
SENAI system in Erazil as "one of the most siccessful experiments in the 
history of Brazilian education" (p. 618) which "revealed outstanding results 
for vocational education, as compared with academic education plus on-the-job 
training" (p. 622). Such a strong view may need to be questioned in the light 
of evidence presented by Miller and Zaidl (1981). They studied the factors 
associated with earnings in multinational companies in Brazil and Mexico in 
the auto and retail sectors (n • 1137). There was no evidence that current 
earnings were associated with formal training either in previous jobs or in 
current job. By contrast earnings were associated with years of education 
and current job tenure, which they interpreted as a payoff to on the Job 
training. Possibly multinationals insist on a mode of vocational training, 
different to that suppMed by SENAI. 
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The studies relating to India, Israel and Kenya all tend to support the 
vocational school fallacy. In Israel formal Vocational Secondary Schools 
have higher costs than other modes of vocational training and may not yield 
correspondingly higher earnings. Levlne suggests that the Vocational Secondary 
Schools may just about yield a tolerable social rate of return over Industrial 
Schools and Short Courses but his figures confirm that apprenticeships are the 
most cost effective training device. Likewise In India the Industrial Training 
Institutes have higher costs and a lower productivity-raising effect than 
formal or Informal In-firm training. Further the productivity effect of 
informal training Is highest for those with the most education (though whether 
It Is sufficiently high to justify the extra schooling cannot be calculated 
from Fuller's data). And In Kenya Godfrey concludes thus: "... the fact 
that tnose who have undergone full-time training courses do worse at all grades 
of test than those who have not suggests at least that the efficacy of such 
courses and of the Institutions which house them needs to be carefully 
examined" (p. 35). 

In uhe most thorough study so far Psacharopoulos and Loxley (1984) 
contrast the educational and labour market attainments of graduates from 
academic and vocational schools and schools with different biases In 
Colombia and Tanzania. Costs and outcomes are related In order to get at 
the external efficiency of the respective schools. Outcomes Include learning 
achievement, ability among secondary school leavers to achieve further 
Education and training* and ultimately to perform In the labour market. The 
primary explicit rationale for diversified secondary schooling and the 
Introduction of vocational or pre-vocatlonal studies, such as industrial 
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arts or agriculture, has been to increase the economic relevance of schooling. 
Therefore it is labour market achievement, rather than Increases in learning 
achievement or changes in attitudes, which is the most important outcome. 
The evidence of this outcome is tentative because not all the sample of 
secondary school leavers surveyed had entered the labour market by the time 
of the survey. A number of hypotheses were examined. For example it was 
suggested that diversification (i.e. vocational as well as academic schooling) 
leads to: 

- less private demand for post-secondary school 

- a closer relationship between school bias and specialisation of 
post-school training 

- a higher propensity for labour force participation at the end of 
secondary schooling 

- employment in the field of pre- vocational specialisation 

- shorter periods of unemployment (job search) following secondary 
school graduation, and 

- higher graduate earnings 

In general, the evidence does not support these hypotheses. In particular 
in Colombia there is no statistically significant difference, other things 
equal, between mean earnings of those on the two different track and in 
Tanzania the "first indications do not corroborate the hypothesis that the 
introduction of pre-vocational studies into secondary schooling can be 
Justified on the basis of the economic payoff being greater than for academic 
schooling" (p. 7-30). The preliminary results of this thorough study therefore 
also support the vocational school fallacy. 
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2.7 Summary 

It Is difficult to generalise on the basis or the studies examined In 
this section because there Is no guarantee that the results would be 
replicated over time or across countries. Nevertheless, some tentative 
conclusions are possible. First, where the rationale for the study was to 
see If any expansion In training facilities was Justified the rate of return 
was typically high enough to justify such an expansion. Second, there Is 
some evidence that In Brazil and Peru short courses have a bigger payoff 
than longer courses of training. Third, training In industrial Institutes 
and vocational secondary schools Is less cost effective than more Informal 
firm-based training, at least In Kenya, India and Israel. Fourth, the payoff 
to quasi -institutional vocational training in South America Is higher for 
those who have only completed primary school than for those who have completed 
secondary school. This suggests that extra formal, schooling may be substltut- 
able for formal institutional vocational training. 
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SECTION 3 

Public training programmes in industrial countries 

Most governments provide funds for public provision of training places. 
In addition they often intervene in an attempt to Improve the way the 
private training market works. In this section we examine some such 
government activities in Britain and the US in order to provide insights 
into training evaluation problems in developing countries. 

Most recent evaluation work in the US has concerned the private gains 
to participants in MDTA or CETA. These evaluations demonstrate the importance 
of longitudinal data (i.e. before and after training) and comparison groups 
(I.e. trainees and a control group). Evaluations which are based on simple 
cross section data or which do not have a control group are likely to be 
misleading. Further, it is shown that placement rates are a poor performance 
indicator of prime sponsors' training efforts. 

In Britain the state provides limited training facilities for adults, 
many of whom come to the training place from employment rather than unemploy- 
ment. Evaluations of such state provision are discussed. It Is frequently 
asserted that the quantity and quality of training is deficient in Britain 
as compared with that in other European countries. Three sorts of market 
failure - externalities, imperfect capital markets and labour market monopoly - 
which could be responsible for this deficiency are discussed. 
3.1 US public training programme s 

There are a number of good surveys which evaluate the impact of US 
manpower programmes (e.g. Borus 1972, Bloch 1979) therefore an extensive 
survey of this literature would be gratuitous. Instead, it is worth 
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focussing on the great difficulty In correctly evaluating public training. 
Most studies simply have not made all the necessary controls (including 
the British studies surveyed below) and it is likely that earlier rate of 
return estimates are awry (see Bassi 1983, 1984 for a clear technical 
discussion of the statistical problems, with an application to CETA). 

We focus on individual (i.e. private) returns to CETA training, and 
its predecessor MDTA. The major difficulty in estimating the Impact of 
training (or education) on earnings is selection bias, sometimes called 
population heterogeneity. In the absence of an experimental design where 
individuals are randomly assigned between groups, it is likely that the 
decision to participate in the training programme, or the selection process, 
is highly correlated with unobservable factors which also help determine 
earnings. This can result in the impact of training being either over- 
estimated or underestimated. For example, individuals may self-select into 
CETA or are selected by administrators on the basis of Innate ability or 
intelligence - on which there is no data. If very able individuals are 
selected onto the training programme, the payoff to training will be over- 
estimated. Assuming that this individual characteristic - Innate ability - 
is constant over time the statistical problem can be overcome by what is 
known as a fixed effects model. What this does is take an earnings function 
p. ior to training and an earnings function post training and difference them, 
thus causing the unobserved innate ability to drop out and leaving the change 
in earnings over time to be a function of participation in CETA. An alter- 
native possibility is to.use an autoregresslve model where pre-training 
earnings are used as a control: previous earnings should capture the 
(unobservable) innate ability fixed effect. 
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There remains a problem with the fixed effects model if creaming occurs. 
If, from among the pool of eligible applicants, administrators choose "only 
those individuals with the highest possible permanent income and the greatest 
negative transitory income" (Bassi 1983, p. 542) i.e. if they choose those 
individuals who are only eligible for the programme because of (temporary) 
bad luck. This problem can be overcome by setting the base period benchmark 
to be a few years prior to programme participation. (There is a further 
statistical problem - simultaneity bias - if the training decision is endogenous 
to the individual, see Kiefer (1979) for a full discussion). 

Evidence on the private returns to public training in the US is given 
in Table 3.1. This shows vividly how Important it is to use a fixed effects 
model or autoregressive model rather than a simple cross section model to 
estimate the returns to training. Kiefer (1979) investigated the return to 
MOTA training using a sample of 600 male trainees and controls. In a simple 
cross section to explain earnings three quarters after training he finds 
training is negatively associated with earnings (earnings here includes both 
the wage and the probability of employment). In this cross section regression 
he controls for age, schooling, race, marital status and region but still 
finds that individuals who went through MDTA training have, other things 
equal, edrnir?s per cent below non-trainees. However, when the analysis 
is done proper.^, using a fixed effects model, training is positively 
associated with f^^imings. It is clear, therefore, that the simple cross 
section result is misleading and iii the result of selection bias - less able 
Individuals went through the NDTA programme and in the simple statistical 
analysis this showed up as training reducing earnings. 
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The most thorough analysis of CETA training Is by Bassi (1983). She 
analyses the 1976 CETA cohort and an equivalent comparison group. The 
change In the annual earnings of CETA participants as compared with non- 
participants Is given in Table 3.1. Participation In CETA Is positively 
associated with the change in earnings and training has a bigger effect on 
women's earnings than on male earnings. 

The autoregresslve method of controlling for selection bias Is used by 
Sawhey et a1. (1982). They study the impact of CETA Title I training 
programmes administered by the Boston prime sponsor. Their comparison group 
Is Individuals who had applied for, but not received, training. They Identify 
separately the payoff to particular types of CETA training like autos, 
clerical etc. The Impact of CETA training is divided Into Its effect on Job 
retention and Its effect on the wage. In both cases the most Important 
determinants of the employment status and current post-training wage are 
the type of training and job ciiaracteri sties, demographic characteristics 
are relatively unimportant. On employment status, those Individuals who 
completed CETA training were 49 per cent more likely to have retained their 
Jobs six months post training than non-trainees. And for those In employment 
CETA training Is associated with trainee wages $0.20 per hour (1976-77 
dollars) higher than the wage for equivalent non-trainees. But there is 
considerable variation round this average: four types of training - medical, 
food preparation, automotive and new careers - yield at least 30 cents per 
hour extra, while shop, clerical, home-maker and electronic training yield 
Jobs paying not much more than those held by non-trainee comparison group. 
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Even proper longitudinal studies, with a control group, seldom have 
information on earnings for a long period after training. An exception is 
the fascinating study of Fredland and Little (1980) on the returns (in 
civilian life) to military vocational training. Their sample Is 1,306 
white men aged 45-49 In 1966, of whom 352 had received vocational training 
in the military often during World War II. A cross section regression on 
1966 earnings was estimated* Control variables Included schooling, job 
tenure, socio-economic status and region. Those who use their military 
vocational training In their civilian jobs get a premium in annual earnings 
of 12 per cent. Those who received, but did not use their military vocational 
education get no pay premium, A similar pattern holds for users and non- 
users of civilian vocational training. These results are Important in 
context of whether vocational training actually raises productivity or 
whether it is merely a screening device. Assuming that there is no ability 
difference between users and non-users of vocational training the results 
imply that such training does raise productivity - it is only the users 
that get a premium. 

Federal manpower training programmes normally use a delivery system 
in wh1c!i the planning of types of courses and choices of schools have been 
the responsibility of either public administrators or various volunteer 
members of manpower planning boards. O'Neil (1977) suggests that greater 
reliance on the private market mechanism might be both more efficient and 
more equitable. Thus the extensive proprietary vocational - technical 
school Industry could be used to supply training places and/or programme 
participants could be given more discretion in choosing both the type of 
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training they wish to take and the Institution they wish to attend by more 
use of voucher-delivery systems. O'Neil examines the payoff to the GI Bill, 
which uses a voucher-delivery system and contains sub-groups of recipients 
and training options that are similar to those of manpower programmes. He 
finds, using longitudinal data with appropriate controls, that the GI Bill- 
supported vocational training is associated with an earnings increase of 
around 10 per cent, rather higher than the estimate (for men) for Federal 
manpower training programmes. Further black veterans participate more than 
non-black veterans in GI Bill -supported vocational training, and they gain 
more from such training than non-blacks. 

We have shown that the most thorough way of calculating the private 
return to public (or private) vocational training programmes is from 
longitudina' data on earnings for participants and a comparison group. In 
view of the fact that it is difficult (i.e. expensive) to collect longitudinal 
data on earnings the US Department of Labor compare the performance of prime 
sponsors and their contractors by constructing placement data. But Gay 
and Borus (1980) show that placement in a job within three months after 
leaving a program is among the poorest performance indicators. This variable 
was not significantly correlated (where the observations are prime sponsors) 
with subsequent gain in earnings for any of the 20 race/sex/programme groups 
they studied. They conclude that "placement data provide no useful inform- 
ation for judging the relative effectivtsness of prime sponsors by the US 
Department of Labor or of contractors by local prime sponsors when considering 
earnings gain", (p. 42). They point to several reasons why merely 
obtaining employment following training is unlikely to be related to the 
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long-run impact of the progranme. First, job placement does not convey any 
information on the nature or quality of post-programme employment. Changes 
In weeks worked, wage rates and earnings each embrace additional dimensions 
of post-programme work experience and thus have a better chance of reflect- 
ing subsequent long run benefits. Second, many job placements are not 
related to the skills acquired during training, so placement may not by itself 
constitute an improvement in a trainee's labour market circumstances. Third, 
additional job search may turn up a job with better long run prospects. 
3.2 Vocational training in Britain 

Three issues are addressed here. First, we describe the extent of 
vocational training in the British labour force and analyse who gets trained 
and the impact of such training on occupational status and mobility. It is 
generally held that the British training effort is deficient compared with 
other countries. Therefore, second, we analyse some economic aspects of 
public provision of adult training. This provides insights into, for example 
cost-benefit analysis using a before/after method rather than a control group 
and the impact of the recession on the payoff to state-provided vocational 
training. Third, not only can the state provide training itself, it can 
also intervene to make the private market for training work better. Various 
market failures have been alleged, including externalities (poaching trained 
labour), imperfect capital markets, and non-competitive labour markets. 
These are examined in turn. The major omission in this discussion of 
vocational training in Britain concerns the recent expansion of public 
support - mainly in the form of allowances - to the Youth Training Scheme 
(YTS). Essentially YTS Is for school leavers who would otherwise be 
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unemployed. Although it Is supposed to have a training cofflponent It was 
Introduced in the face of rising youth unemployment rather than because of 
concern over the quantity and quality of teenager training. In ar^ event 
the YTS only came on stream In 1983 so It Is too early to evaluate it yet. 
Extent and effects of vocational training in Britain 

The Nation*] Training Survey was commissioned by the Manpower Services 
Commission in 1975 and 1976 to provide a comprehensive picture of the stock 
of skills in the labour force, the education and training undertaken to 
acquire them and the uses to which they were put. Some 54,000 people were 
Interviewed, representing l-ln-500 of the working population. Training was 
very broadly defined, as "anything which may have helped you do the work**. 
This definition covered all the types of vocational courses, both on-and-off 
the job, but excluded academic courses at colleges i.e. It excludes much 
vocational training which leads to a formal qualification like a teaching 
certificate (Claydon 1980). Over 60 per cent of respondents said they had 
undertaken some form of training during their working life (three quarters 
of men compared to half of the women) and almost half of this had been on- 
the-job. This implied that 11.5 million men and 7.5 million women In the 
working population had received some training. 

Greenhaigh and Stewart (1982) have analysed the NTS data using a logit 
model to see who did and did not receive full-time training (as c*efined 
above) during the period 1965-74. Separate Information Is presented for 
men, single women and other women. Not surprlsinqly age has a stronger 
effect on the probability of training than any other variable. Each 
additional year of age reduces the probability of training by 6 per cent. 
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The occupational position at the start of the ten year period (1965-74) Is 
positively related to the probability of training during the decade for 
men and single wom:n but negatively related for married women, likewise, 
for men, the higher the qualifications possessed at the beginning of the 
period the more likely a spell of training during the period. Finally, 
married men are more likely to have a spell of training than single men. 

The Impact of training on occupational status has also been examined. 
Greenhaigh and Stewart (1982. Table 10) find that, for men. a spell of full 
time vocational training pre-1965 of a yea** or longer raises the occupational 
status in 1975 by 7 per cent and a spell of any length betwen 1965 and 1975 
has a similar effect. Metcalf and Nickell (1982) confirm that occupational 
movements between 1965 and 1975 are positively associated with vocational 
training: those men who had a short course of full-time vocational training 
(4 weeks or less) rose In the occupational standings by 1 per cent for each 
week of such training. 

Vocational training is. other things equal, associated with a higher 
level occupation. There has also been concern in Britain that, as compared 
with Germany, the extent and;type of vocational education is associated with 
the economic performance of the country (Prais 1981, Sorge and Warner 1980). 
Prais argues that the essential difference between Britain and Germany is in 
the proportions of th^ labour force with IntertMdiate qualifications such as 
apprenticeships or full secretarial qualifications. The figure for Britain 
is around 30 per cent while the corresponding German figure is twice as 
large. The German system emphasises formal exams, both in classrooms and 
on-the-job, while the British system Is more informal and has no proper test 



C3 



55 



of the on-the-job training element. Prals concludes that "In a world of 
more rapid technical progress and faster economic change, the balance of 
advantage has shifted towards systems which provide a much greater stock 
of transferable skills, In which formal training and external examinations - 
of both theoretical and practical aspects - play predominating roles". 
Sixty five years ago Alfred Marshall (1919): wrote that "All the world has 
much to learn from German methods of education" Md Prals demonstrates that, 
for Britain at least, that Is still true. We now turn to examine state 
provision of adult training snd the role the state might play In correcting 
market failure which results In the underprovlslon of skilled labour. 
Public training programmes f or adults In Britain 

Some £3 billion is spent on alj^ adult training throughout further 
education and Industry. Most public spending on adult training and 
retraining Is via the Training Opportunities Scheme (TOPS). This offers 
(1) training to unemployed Individuals In skills which are Intended to lead 
directly to employment, (11) work preparation courses to reduce particular 
difficulties experienced by some people In finding Jobs. Full details of 
TOPS training Is given In Table 3.2. TOPS cost £230 million In 1982/83, 
of which £72 million was the cost of the ski 11 -centres (ur of trainee 
allowances). The MSG. has a network of 68 ski 11 -centres and 20 annexes which 
employ 4,500 staff and which supply off-the-job training under MSG programmes 
and to employers who contract for their services. Ski 11 -centre courses last 
for around six months and the Individual Is trained to near craft standard. 
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TABLE 3.2 

Training institutions used and skills taught under TOPS 1982/83 



Institutions used 




Skill -centres 


27.900 


CFEs and private colleges 


29,900 


Employers establishments and HGV 


5,800 


Residential training centres 


700 




59,300 


Skills taught 




Clerical and commercial 


10,800 


Business 


1,200 


HGV 


450 


Construction 


5,800 


Technical and computer 


7,000 


Engineering and automotive 


13.300 


Work preparation 


12.500 


Other 


8,2C0 




59,300 



Source: MSG (1983 Tables 4.1 and 4.2). 

Note: Figures refer to number of training places. Courses 
typically last under one year, therefore the number 
of people trained in 1982/83 was greater than the 
number of places. 
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The payoff to skill -centre training (skill-centres were previously 
named Government Training Centres) has been analysed In a whole series of 
publications by Ziderman (1969, 1973. 1975, 1975a, 1976, 1978). Some 
typical results are reported in Table 3.3. In all this reserach Ziderman 
had no control group therefore he uses the before/after method (see Section 6). 
He only has earning information for the period up to around 2 years post- 
training, so he assumes the pay differential at the 2 year post-training 
point will persist into the future. As he has no control group he has no 
Information on what the employment and earnings experience of the trainees 
would have been If they had no been through the GTC. Therefore he uses a 
stochastic Markov chain model to predict by computer simulation the 
hypothetical employment pattern of enrol lees in the absence of training. 
The employment status of "non-participants" (i.e. of the enrol lees, had 
they not, infact, participated in the programme) is estimated in terms of 
proportions unemployed and employed, at various points of time from the 
start of the progransne. These, together with earnings data relating to 
trainees in the 'before' period (suitably corrected for the secular rise in 
Incomes over the period) provide estimates of mean earnings that programme 
enrol lees would have received had they not participated in the programme. 
The private rate of return to GTC training is higher for those who were 
employed prior to training than those who were unemployed because of the 
post-training. The social rate of return is below the private rate and its 
value depends on the assumptions made about replacement and displacement. 
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TABLE 3.3 

Rate of return to Investment In GTC training In 1968"69 i%) 



Time 
horizon 
from 
start 
of 

training 


Private 


Social 


Unemployed Employed , 
prior to prior to 
training training 


a,0 -0 a,0 • 0.25 a»0 • 0.75 
Y"0 Y«0 Y" 0.25 


2 years 
10 years 


< 0 33 
58 86 


< 0 < 0 < 0 
4 25 47 



Notes: a > replacement factor 

6 ■ displacement factor In non-training trade 

Y ■ displacement factor In training trade 
Source: Zlderman (1975 Table 13.2], Zlderman and Driver (1973 Tables 2 and 3). 
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In all cases except zero replacement and displacement the rate of return 
adopting a ten year time horizon shows that in the 1960$ the investment was 
very profitable and this is one reason why public adult training places 
were expanded in the 1970s. 

Some attention has been given to where state adult training centres 
should be located. Hughes (1975) suggests that the regional location 
pattern should be based on: (i) total applications for GTC courses per 
region in relation to training places available, should the policy objective 
of GTCs be social rather than economic; (ii) Incidence of structural 
unemployment, in relation to training places, if economic objectives prevail; 
and (ill) as a supplementary criterion, the capacity utilisation rate, as 
a measure of the efficiency with which the capacity is used. On the basis 
of these criteria Hughes argues that the northern part of Britain is over- 
endowed with GTC places relative to the southern part (historically the 
northern part of Britain has an unemployment rate double that in the southern 
part). But Ziderman argues that location decisions should be based on cost- 
benefit analysis and shows that the social payoff to GTCs (now skill centres) 
is higher In the north thin the south. This debate is unresolved but is 
clearly Important, particularly if the supply of training places is to be 
contracted or expanded. 

There is evidence that the high rates of return to public training of 
adults (Table 3.3) are now a thing of the past. The employment experience 
of TOPS graduates at the end of 1982, three months after finishing their 
courses was: 
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Skin centres 



Non-skill centres 



Ui employment (X) 

In employment » using skills {%) 



44 



57 



34 
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Thus only around half the graduates from training programnes were in employment 
three months after finishing their training and only two fifths were using 
their skills. The difference between the skill centre figures and those for 
non-ski 11 -centres partly reflects the poor employment prospects in the 
MChanical engineering craft occupations which form a significant proportion 
of ski 11 -centre training. In the face of this evidence the TOPS programme 
Is to be halved. Ski 11 -centres will, in future, operate on a cost-recovery 
basis (i.e. the individual or the firm will be charged for the training) 
ifhich will cut down on speculative training. Rather public spending on adult 
training will in future concentrate on upgrading technical skills (50,000 p. a.) 
and will help training in information technology (50,000 p.a.). This expansion 
In the training progranne is mainly addressed to already-employed workers and 
seme schemes will be financed by loans (rather than trainee allowances and 
zero fees). Unemployed people will be catered for malhly by-splicing a 
training component into the Community Programme for the long term jobless. 

There will also be a big expansion in training for self employment: 
Around a tenth of th British labour force is self employed. The New Enterprise 
Programme (NEP) is designed to train people for self employment. It is 
directly financed by the Manpower Services Commission (MSC) which specifies 
the objective of NEP as getting people into business "quicker, with fewer 
Mistakes and surviving longer". Participants on the NEP must normally be 
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unemployed at the time they go on the course. Each programme lasts 16 weeks. 
The first month is a residential period at a Business School and the remaining 
twelve weeks are spent putting a business proposal into practice. A small 
NEP has been evaluated by Johnson and Thomas (1982). The cost side was 
straightforward. But the benefits side is problematic. They had no control 
group so they simply asked trainees what their employment would have been in 
the asbence of training. The Interview took place two years after the NEP 
and they assume that the benefits last for five years. Thus participants 
had to forecast actual employment for years 3, 4, 5 and alternative employment 
for all five years. The authors made various assumptions about the extent to 
which the output of the new firms displace output of existing firms. The 
calculated social internal rate of return (using only a 5 year benefit period) 
Is 20 per cent. This suggests that the proposed expansion of training for the 
self employed is sensible. 

Public intervention to support training provided by firms 

It is generally believed that Britain has insufficient skilled labour. 
Three market failure arguments - externalities, imperfect capital markets and 
labour market monopolies - have been advanced as possible causes. 

First, the 1964 Industrial Training Act established a system of Industrial 
Training Boards (ITBs} with the right to impose levies on and to pay grants 
to firms. The object of the Act was to increase the supply of skilled labour 
by "re-distribution of the burden of providing industrial training from firms 
which were relatively generous providers to those which undertook relatively 
little" (Jones and Hollenstein 1983). Supporters of the grant-levy approach 
argued that some firms incurred net costs to provide training in skills which 
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were transferable among firms. In turn, firms not providing training poached 
away the trained labour. This, it was argued, was unfair and Inefficient 
because ultimately the supply of firms providing training would dry up. But 
there was no analysis of how this situation arose In the first place and how 
poachlng-flrms and training-firms existed side-by-slde. 

Second, opponents of the grant-levy approach argued that the costf* and 
benefits of general training for transferable skills accrued to the Individual 
and poaching was therefore Irrelevant. Rather, If there were not enough tralntcs* 
this was because the capital markets were working badly and Individuals could 
not borrow to augment their skills. In this case the solution to any deficiency 
In the supply of trained labour was not to Introduce a grant-levy system but 
to Intervene to Improve the supply of funds for Investment In human capital. 

Third, there may be an Insufficient supply of generally trained labour 
with transferable skills If trainee pay Is high relative to the earnings of 
skilled labour. Jones and Hollenstein show that the higher Is trainee pay 
relative to that of skilled workers, the lower will be the employers' demand 
for all types of trainee labour and the less skill-Intensive and more firm- 
specific on average will be the training opportunities offered. In Britain 
the earnings of apprentices and other Initial trainees are double or treble 
those of apprentices In Germany and Switzerland over the period of their 
apprenticeship and It Is unlikely that their productivity Is correspondingly 
higher. Three solutions suggest themselves to this problem: (1) parties to 
the pay bargain might try to mirror the competitive outcome more nearly; 
(11) trainee wages could be subsidised; (111) more general training could 
be provided In public sector Institutions. 
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3.3 Sutwnary 

The supply of skilled labour In Industrialised countries may be deficient 
because of externalities (poaching), imperfect capital markets which make it 
difficult for a person to finance his training or labour market monopolies 
Mhich cause the trainees wage to be high relative to his productivity. The 
state therefore sometimes intervenes to increase the supply of skilled labour* 
Forms of intervention include a levy-grant system, subsidising trainee wages 
and public provision of training slots. 

The studies surveyed here evaluate public training programmes by using 
earnings data. The results suggest that the best evaluations have both 
longitudinal earnings data for the period before and after training and 
observations on trainees and a control group of non-trainees. These lessons 
are digested and elaborated further in Section 6 and 7. 
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S ECTION 4 
Substitution 

4.1 Introduction 

Before thinking about the method of evaluating vocational training two 
prior Issues need to be considered. First, Is the production technique in 
the flm or Industry economically efficient? If It Is not, and a more labour 
Intensive technique would be appropriate, then employment of both skilled and 
and unskilled labour miqht need to rise. Second, given the output and the 
capital is it possible to substitute less skilled for more skilled labour? 
Therefore we must pay a passing glance to the elasticity of substitution 
between capital and labour and between different labour types. 

There are many reasons for estimating such substitution elasticities. 
These reasons Include: to test the helpfulness of manpower plans; to 
determine whether or not extra education is a powerful vehicle to alter the 
income distribution; growth accounting; to test the impact of subsidies on 
either capital or labour; and to see the substitution possibilities within 
a training programme. It is this last point that is examined here. 
Empirical estimation of the elasticity of substitution is necessary to study 
the effect of a training programme which converts low to high skilled labour. 
The effects depend on how substituta^le these are in production, for the 
substitutability will determine the extent of the change in their relative 
wages in the new post-training equilibrium. A positive value for the 
felasticity implies that the factors are substitutes and a negative value 
implies that they are complements. 

4.2 Appropriate technology and the demand for skilled labour 

The Issues of the appropriate production technology is controversial » ' 

especially in developing countries. For our purposes the important strand 
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of this analysis Is the skill requirements Implied by a more labour-intensive 
technology. Even lower skill Intensities In the appropriate least cost 
technology may require a larger absolute number of skilled workers given the 
greater total employment. 

Some evidence on this Is given In Table 4.1 taken from Pack's (1982) 
Illuminating survey. In shoes and leather processing the appropriate (I.e. 
more labour-intensive) technology requires a higher proportion of skilled 
workers than the capital Intensive technology, while in brickmaklng and 
maize milling the skill intensity of the labour force is higher with the 
capital intensive technology than with the appropriate technology. But even 
lower skill Intensities in the appropriate technology In brick production 
and In maize milling require a larger absolute number of skilled workers. 
As Pack points out, critics who are sceptical of the feasibility of labour- 
intensive technology might well feel vindicated by such a result: even in 
brickmakingv in which the skill Intensity per project is lower with the least 
cost technique, the aggregate skill requirement Is greater. That requirement 
reflects both the larger total employment per project and the larger total 
number of projects that can be undertaken given their lower capital -output 
ratio. 

But the analysis cannot end here. Pack points out that what Is required 
is a calculation of the cost of obtaining the additional skills and a 
comparison with the benefits to be obtained from the choice of least-cost 
technology thus made possible. Table 4.2 presents such computations for 
leather processing and for shoe manufacturing, the two sectors showing the 

largest absolute Increase In skill requirements. The figures are the benefit- 
cost ratios that prospective Investors could anticipate from expenditure on 
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TABLE 4.1 

Skill differences between processes > by sector 



Sector 

WW W WW i 


Percentage of skilled workers 


Absolute difference In 
number of skilled workers 
required per £100 million 
of investment (appropriate 
minus capital Intensive) 


Economically 
efficient 


Capital- 
intensive 




58 


55 


5.744 


Leather processings*^ 


42 


26 


1,464 


BricknidkingS*^^ 


2 


7 


445 


Maize millingS*^^ 


9 


13 


746 



Source: Pack (1982), Table 8. 

Notes: (a) With appropriate technology both the proportion and the absolute 
nurriber of skilled workers rises. 

(b) With appropriate technology the proportion of skilled workers 
falls but the absolute nuiriber rises. 
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skllls necessary to Implement appropriate technology. These are Indeed 

"remarkably high" and "they suggest that those who believe skill constraints 

to be the principal factor limiting the adoption of labour-intensive technologies 

might consider advocating a bundling of the requisite education and Investment 
funds rather than urging a resort to capital -Intensive technologies" (p. 24). 
While training associated with Bank projects typically takes the technology 
as given the need for such labour-skill upgrading would be even greater, it 
seems, with appropriate technology. 
4.3 Substitution among different types of labour 

If the technology and output level are taken as given we should ask 
whether different types of labour are substitutable for each other in the 
production process. If it is easy to substitute unskilled labour for skilled 
labour (i.e. if the elasticity of substitution is high} obviously training 
Is needed less than if such a substitution Is difficult (i.e. if the elasticity 
of substitution is low). 

Before turning to the results of various studies I wish to mention, very 
briefly, some serious estimation choices and problems, which interact to 
cause us to treat the estimates of the substitution elasticity with some 
scepticism. 

First, is the elasticity of substitution between different labour types 
to be estimated via a production function (e.g. Layard et al. 1971), a cost 
function (e.g. Nissim 1982) or simply by contrasting relative wages with 
relative employment levels? Most studies use the last approach. 

Second, the observations can be drawn froiri time series or a cross section. 
If cross section data are used they can refer to countries, regions. Industries 
or firms. 

f ; 

ERIC 
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TABLE 4.2 

Benefit-cost ratios from investment in upgrading skills 



Sector 


Assumed borrowing rate 
of skilled workers 




m 


20% 


Shoe manufacturing 


35 


68 


Leather processing 


54 


105 



Source: Pick (1982), Table 9. 

Notes: The benefit-cost ratio is calculated as folvlows 
B/C « aY/(Sjj-S^)G, where: 

aY is the present discounted value (is.10) of the additional 
non-wage income obtained from the appropriate technique 

G is the amount of investment in upgrading skills that would 
now ha^'e to be spent by a firm on each currently unskilled 
worker to obtain the requisite skills to produce with an 
appropriate technology 

Su and S, are the number of skilled workers required by the 
D a 

appropriate and capital-intensive technology per 
£100 million of investment 
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Third* how should the labour Input be defined? For our purposes 
we ere Interested In studies of substitution between skilled and unskilled 
labour or between labour with different education levels rather than between 
age categories or sex. But how aggregate or disaggregate Is the level of 
skill to be defined. Host studies aggregate labour Into only two or three 
categories. This Is bound to miss something. For example* It may well be 
that substitution possibilities are greater between (say) semi-skilled and 
unskilled workers than they are in the higher categories of management. 
Layard et al. (1971) attempted a fivefold classification of labour In their 
study of the relationship between economic performance and qualified manpower 
In 68 factories in the electrical engineering industry. They were unable to 
say anything definite about substituting more trained for less trained workers 
and Indeed* were forced In the end to estimate the production function with 
only two labour types. (We may note In passing that such aggregation Is one 
reason why manpower forecasting Is ostensibly so attractive - it has a range 
of occupational titles that cannot be matched In substitution studies or rate 
of return analysis). 

Fourth* most studies use the "short cut" estimation method of associating 
relative wages by skill group with relative employment by skill group and 
simply assume that the observations lie on a labour demand curve. Tinbergen 
(1974) points out that strictly studies should control for the elasticity 
of supply of labour too but very few do so. For an example of a study that 
*d1d make such a control see Fallon and Layard (1975). 

Thus* fifths there Is a question of the simultaneous determination of 
relative pay and relative employment. However* when such an association Is 
tstliMted at Industry level It seems correct to take relative wages as the' 
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exogenous variables (e.g. Knight 1979). This In turn raises a further 
related problem: when the observations refer to one country - industries 
or firms perhaps - there may be insufficient variation in relative wages 
to obtain good estimates of the substitution elasticity. 

Sixth, what other variables should be Included in the statistical 
analysis? In cross country studies it seems Important to control for 
industrial structure (Bowles 1970). If capital is ignored, as it is in 
mar^ studies, we get biased estimates of labour - labour substitution 
unless labour is separable from capital, i.e. unless the elasticity of 
substitution between capital and the various types of labour skills are 
identical. When capital and industrial structure are included In the: 
analysis and we also control for the supply elasticity the resulting 
estimates of the substitution elasticity fall sharply compared with 
estimates made without such controls. 

The results of some studies which have attempted to analyse labour - 
labour sustitution are given in Tables 4.3 and 4.4. Table 4.3 presents 
estimates from cross section studies and Table 4.4 from two studies which 
use time series data. The results are selective because the authors 
typically present more estimates than I have reported. The results seem 
clear on two counts. First, unskilled labour and skilled labour are 
generally substitutes (i.e. the sign of the elasticity of substitution is 
positive). Second, the size of the substitution elasticity is perhaps 
' somewhat smaller than was thought on the basis of previous estimates done 
more than a decade ago. These results are in line with those surveyed by 
Hamermesh and Grant (1979) for the U.S. who conclude "Almost all the studies 
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Selected cross section estlnates of the elasticity of labour-labour substitution 



Author 


Sample 
year 


Observations 


Type of 
function 


Independent 
variables 


Elasticity 
of 

substitution 


Labour 
type 


Bowies (1970) 


1960s 


12 rich and poor 
countries 


Inverted labour 
demand 


Relative employment 
Industrial structure 


5.9 


0-7 years ed/ 
84> years ed 


Psachamopoulos and 
Hinchcllffe (1972) 


1960s 


9 rich countries 


Inverted labour 
demand 


Relative employment 
K : L 


20 


8-U years ed/ 
12-1- years ed 






9 poor countries 


Inverted labour 
demand 


as above 


2.5 


8-11 years ed/ 
124 years ed 


Fallon and Layard 
(1*75) 


1963 


23 countries 


Simultaneous 
labour supply, 
labour demand 
model 


Capital stock (0) 
Relative 

employment (D) 
Rate of return (S) 
Output per head (S) 


1 .1 


Human capital/ 
raw labour 




1963 


Mining 
16 countries 


Labour demand 


Relative wages 


.78 


Human capital/ 
raw labour 






14 countries 


1 sKniiv* HonuinH 

Lfloour WrHMnu 


nciaviVc W4igc> 


90 


UllHUIII ^M9%A¥m^ I 

nuincin vopi i / 

raw labour 




1963 


Utilities 
16 countries 


Labour demand 


Relative wages 


.44 


Human capital/ 
raw labour 


Mimed (1981) 


1979 


Construction firms: 














20 Rawlpindl 


Labour demand 


Relative wages 


-0.65 


Skilled/unskilled 






15 5 other cities 


Labour demand 


Relative wages 


0.66 


Skilled/unskilled 






35 all 6 cities 


Labour demand 


Relative wages 


0.21 


Skilled/unskilled 



Note: Estimates from Layard and Fallon are averages from the range of estimates they give. 
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TABLE 4.4 

Selected time series estimates of the elasticity of labour- labour substi tut ion 



Author 


Sample 
years 


Observations 


Type of 
function 


Independent 
variables 


Elasticity 
of 

substitution 


Labour 
type 


Nissim 
(1982) 


1963-78 


G,Q. mechanical 
engineering 
(n=22) 


Oynditiic trans log 
cost function 


Wages 
Capital stock 
Output time 
trend 


1.7 
2.6 

3.7 


Skilled/unskilled 
Skilled/semi -skilled 

Semi-skilled/ unskilled 


Knight 
(1979) 


South Africa 

1955-76 
1955-76 
1955-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1962-76 
1964-76 

1964- 76 

1965- 76 


Aggregate Mix 
Gold mining 
Other mining 
Basic metals 
Wood 
Chemicals 
Electrical machinery 
Food 
Furniture 
Leather 

Machinery 
Metal products 
Transport 
Textiles 

Paper 
Beverages 
Tobacco 


All examples are 
2 tier production 
function 


Relative employment 
time trend in all 
cases 


.39 
.14 

-.25 
.02 
.17 
.03 

-.09 
.14 
.42 
.58 
.20 
.01 
.68 
.14 

-.93 
.22 

-.06 


Black/white In 
all cases 
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flnd that production workers and capital are substitutes, as are production 
and non-production workers" (p. 529). Likewise, Tinbergen and Psacharopoulos 
(1963 Table D4) surveyed nine studies and in each case found that highly 
trained labour and other labour are substitutes In the process of production. 

The thrust of these results from statistical analyses is confirmed in 
an Illuminating case study approach which examined the labour and capital 
Inputs in a number of thermal power stations over a range of different 
countries (Shiba 1983). It was found that given the technology "a high 
level of education can be substituted for lack of experience" and across 
plants the average experience level of the labour force is negatively 
associated with the level of education. Further, more sophisticated 
technology requires a higher level of education and experience, confirming 
the complementarity between physical and human capital. 
4.4 Conclusion 

The results discussed here have two important implications for vocational 
training. First, economically efficient production technologies sometimes 
Imply more labour intensive technology which. In turn will tend to raise the 
demand for skilled labour and in turn, vocational training requirements 
increase. Second, in general, holding output constant, less skilled labour is, 
apparently, a substitute for skilled labour in the production process rather 
than a complement to it. Indeed, it may well be that the studies surveyed 
here understate the true degree of substitutability among different labour 
•types (see e.g. Bennell). Thus labour is usually measured according to 
the occupation-description ("electrical engineer") rather than what the 
person actually does ("maintenance technician"). Training design certainly 
needs to operate on the basis of tasks rather than labels. Although the ' 
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studies surveyed In this section do not relate specifically to the level 
of the firm (typically the data refer to Industries or whole economics) 
the possibility that less skilled labour Is substltutable for more skilled 
labour, and vice versa, needs careful Investigation prior to any evaluation 
of vocational training. 

APPENDIX 

The elasticity of substitution (o^j) between different types of labour 
and Lj represents the Inverse of the percentage change In the ratio of 
wages assolcated with a given percentage change In the ratio of labour 
quantities. Explicitly: 

a(L^/Lj)/(L^/Lj) 

°U " ■ 3(W^/W^j/(W^/Wj) 
3 log (^/Lj) 

= ' a log (w^/Wj) 

A positive value for the elasticity Implies that the factors are substitutes 
and a negative value Implies that they are complements. 
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SECTION 5 
Firm level studies 

5.1 Introduction 

"Recent work on the economics of training has tended to dismiss the 
possibility of using data obtained from individual firms" stated Thomas et a1. 
(1969). Some fifteen years on that statement is generally still true. This 
Is a pity because the few studies conducted at firm or plant level are 
outstanding. In what follows we Initially examine one recent study which 
focusses on training costs* paying special attention to the thorny problem 
of estimating the costs associated with training carrlel out jointly with 
the production process. Then three Issues on the benefits side are examined. 
First, if earnings are not used, how can extra output associated with the 
training be measured? it turns out that a rich variety of measures have 
been used Including downtime, firm output. Job performance and reduced 
turnover. Further, training may reduce input costs rather than increase 
output. Second, what do firm-level studies tell us about experlenc^^ - 
earnings and experience - productivity profiles? In particular is the 
assumption of human capital theory that the experience-earnings profile can 
be explained by the experience-productivity profile confirmed? This is of 
profound importance to those who wish to estimate firm-level or social rates 
of return to training. In fact, the eviui^ace counsels caution on the use of 
human capital theory. Finally, we briefly note two studies, one for the US 
and one for India, which have related a (non-earnings) output measure to 
the type of training received. 
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5.2 Training costs 

An early study of training at the firm level (Thomas, Koxhant and Jones 
1969) Identified seven dimensions of the cost of training: initiating the 
training function; servicing and co-ordinating the training function; 
fixed training capital; working training capital; providing Instruction; 
giving Instruction; and wages of trainees, net of trained output value. 
These costs were fully discussed In Zymelman (1976). More recently Ryan 
(1980) suggested three cost categories In his lucid and complete examination 
of an arc welding training programme at a major US shipyard. 

The flavour of Ryan's analysir is given In Figure 5.1. He defines 
job training as comprising "all forms of learning which raise an individual 
from requisite general educational attainment towards the level of competence 
characteristic of experienced workers in the job in question" (p. 334). The 
curve p.y (t) in Figure 5.1 depicts the learning curve of trainee net output 
(valued at a price p) for a training programme consisting of an initial 
spell of formal training in a company school (Ot, periods) followed by a 
phase of informal training consisting of Instruction and/or learning by 
doing on actual production work. The training period is defined not by the 
period of explicit instruction in job techniques but by the time (Ot) it 
takes a typical individual to obtain the plateau of output, y. 

Ryan indicates that both the employer and trainee may bear the costs 
of Job training. The individual bears costs in the form of foregone earnings. 
*Xf his actual path of earnings is defined by w(t) and his alternativt 
earnings by w'(t) then foregone earnings are represented by area bed. The 
cost to the firm is trainee pay less (net) trainee output. In Figure S.l 
this is given by the area abef. 
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FIGURE 5.1 
The cost of in-service training 




TIME ON JOB 



Notes: p.y(t) value of net output in period t 

w(t) compensation of worker in period t 
w'(t} best alternative income of trainee in period t 

Source: Ryan (1980), Figure 1. 
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Flrm level case studies Indicate that it is possible to get at the 
costs of formal training, possible - but tricky - to get at foregone earnings, 
but very difficult to calculate the net costs of informal training. 

Ryan states that "the most accessible costs are the resources connltted 
by employers to courses of formal training conducted in company schools, 
which can be estimated in a relatively straightforward manner from accounting 
records and purchase prices". Earnings foregone can be got from direct 
estimates (this is what is done in the recent evaluations of government 
training, where earnings in (last) employment prior to training are used), 
personal interviews and data on the relevant labour market. 

Estimating the cost to the firm of on the job training is difficult. 
Problems include: (i) the price the output of the trainee is sold for; 
(ii) how to measure trainee output; (iii) how to measure trainee usage 
of other resources such as equipment and instruction, and of the value to 
the firm of alternative uses of such incremental resources: thus we 
require information on the variation with (in) experience of productivity 
supervisory requirements, machine wear and tear etc. Valuation of trainee 
output (i.e. problems (i) and (ii) above combined) is the most difficult 
task. Ryan points out that as most workers perform only a subset of the 
many operations involved in the completion of a marketable product, a 
shadow price is required for their intermediate products. There are two 
possible ways of estimating shadow prices: 

(a) via the p ayments system: Thomas et al. (1969) use the ingenious 
assumption that pay and value product of trainees are equal at the 'breakeven* 
level of output level which makes a worker eligible for bonus payments. 
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However, this assumption is arbitrary. As Ryan points out, it requires 
that the design of the payment system be informed by the very same training 
costs which are to be estimated on the basis of ossumption. 

(b) via the finances of the training programme i.e. from the influence 
of such a shadow price on both the costs and returns of informal training. 
If an exogenously imposed rate of return could be assumed the shadow price 
of output would be uniquely determined for a given rate of labour turnover. 
In general, there is no unique value to trainee output. Ryan therefore 
proceeds on the basis that the cost to the firm of informal training is 
estimated by assuming equality between the pay and value product of experienced 
workers. 

Ryan's analysis refers the cost of the core skill required of all 
shipyard welders, the manual welding of heavy guage steel plate with the 
use of coated electrode. The training process consists of an initial spell 
of between six and eight weeks of formal instruction and practice in a 
vestibule school, followed by a year or more of production work until 
proficiency is acquired. Welders are hired at all stages of the learning 
curve. The cost to the firm of training a beginner up to Mechanic status 
is given in Table 5.1 ($1,975). The total cost to the firm was almost 
$6,000. By contrast Ryan calculates that the trainees Incurred no financial 
costs - their pay was greater than their best alternative income. The 
returns to the firm from this Investment are examined in the section on 
pay, productivity and experience. 
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TAtLE 5.1 

Fifn cm if tninlnt • wtldcr. U.S. shipyard. $1975 



Cost 


$ 


Fomtl trtlfilng 




m rim 


122 


TrtlJilnf 


1772 


Hy of trilntts 1341 




Pay of instructors 253 




Materials etc. 178 




Sub total 


1894 






Ny above output value 


3858 


Extra iwintenance 


333 


Supervision 


482 


Extra electrode inaterial 


376 


Sub total 


5070 


Reduce ttiii sub-total to illow for fact that value product 
of esyeriefieed welder muit in general exceed his pay. say 
by 20i. TlMrtfert multiply 5070 by 1.0/1 .2 


Revised sub tetal 


4008 


TOTAL: 


5902 



• 

Source: l^an (1980), Tables 2 and 3. 
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5,3 Profluctlvlty, output and input 

Ariy evaluation of training must have a measure of tKe beMfItt of 
that training. Typically such benefits are Measured fr«a eanilnfs data. 
But earnings may not. In fact, reflect productivity. Ftr exenple, pay 
may be related to seniority. Or pay scales nay be nandattd. Or multi- 
national companies in developing countries may have their omi peculiar 
pay scales. And even in the human capital version of earnings detemlnati 
at any point in time pay need not equal productivity. Therefore in this 
section four alternative ways of measuring productivity art exMlned. 
First, Job performance assessed by supervisors Is discussed. Second, 
the production function approach - possible where data exist cn Inputs 
and outputs over a cross section of plants - is presented. Next we 
describe one of the most Ingenious studies which details downt1«e in 
productive equipment. Finally the relationship between labour turnover 
and productivity is noted. 

Job performance 

Human capital theory assumes either explicitly or Implicitly, that 
the reason pay rises with experience is because productivity rises with 
experience. This has recently been tested by Nedoff (IMO) and Nedoff 
and Abraham (1981). Here we are only concerned with their Mature of 
productivity. Their results, which have profound implicatlofvs for 
evaluating training, are discussed below. I concentrate here on their 
'discussion of company C (Mddoff and Abraham 1981), but the discussion 
of companies A and B (Medoff 1980) Is similar. 

The sample is 8,238 white male minagerial and preftssltMl e«f1oyees 
at a major US Corporation iu the mid 1970's. This ce«pi*^J< UMS twe 
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separate measures of job performance: an overall performance rating wItSi 
nine categories and a ranking of each employee relative to others in an 
appropriate comparison group. These measures are prepared by each employees 
immediate supervisor. Thc: performance rating form gave supervisors the 
following instructions: "Each employee should be rated on current performance 
and contributions based on requirements of his present assignment. An 
employee should be measured both as to his contribution in terms of the 
standard of his job and against others performing similar work at similar 
levels. Career potential and promotability should not enter into ratings 
of an individual's performance". For the rankings management provides 
each supervisor in a department or other appropriate organisational unit 
with a list of employees doing reasonably comparable levels of work. 

The crucial question is whether these performance ratings and rankings 
are good indicators of relative-within-grade level productivity. Medoff 
and Abraham believe that they do measure productivity satisfactorily, but 
they raise four potential problems. First, in view of their findings 
(see below) that performance declines with seniority, are senior workers 
systematically underrated? For example supervisors might have higher 
expectations of more senior employees in a grade level and systematically 
give them more difficult assignments. In this case rated performance would 
be an understatement of senior employees relative within grade level 
productivity. They found no evidence that supervisors do expect more of 
more senior employees within a grade. 

Second, an objective measure of productivity would be preferable to 
rated performance. But is is particularly difficult to get such an objective 
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measure. The various dimensions of an employee's current true value to his 
or her firm would have to be quantifiable. Further, either there would 
have to be only one dimension relevant for assessing the employees true 
current worth or the researcher would have to know the proper set of weights 
to attach to each relevant dimension. 

Third, there is cause for concern if performance ratings did not 
reflect solely the employees productivity in his current job, but also 
reflected his supervisors assessment of his potential for advancement. 
Other things equal more experienced (older) employees are typically less 
likely to be promoted out of any given grade than less experienced (younq-r) 
employees: older employees are perceived as having limited potential for 
future advancement. Therefore if performance ratings are affected by 
supervisors assessments of individuals future potential, more experienced 
workers might typically receive lower performance ratings than warranted 
on the basis of their current productivity. In fact, Medoff and Abraham 
find that this is not a problem. 

Fourth, a test of whether performance ratings adequately measure 
productivity concerns promotion probabilities. Assume a company is more 
likely to j>romote or give large pay rises to those employees in a grade 
level whose current productivity is highest. Therefore if rated performance 
has a singificant positive relationship with the probability of promotion 
or the size of a pay rise this is good evidence that performance measures 
are positively correlated with true within-grade level current productivity. 

There is also a further problem. Performance ratings may satisfactorily 
measure relative productivity among individuals but the ratings may not 
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accurately reflect the absolute differences, and it is these absolute 
differences which matter when evaluating training. Performance ratings 
may be satisfactory for ordinal rankings but inadequate as a cardinal 
scale. 

Fuller (1976) also used worker efficiency ratings as a measure of 
job performance. His single firm case study was designed to get at the 
cost-effectiveness of different types of training in three metal trades - 
turners, millers and grinders - in a large firm in southern India. Fuller 
describes the efficiency rating measure as follows: "For each metal 
cutting Job standard hours had been estimated for the completion of various 
tasks. These were based on extensive time and motion studies. A worker's 
efficiency rating was completed by dividing standard hour estimates by actual 
hours required to complete the task. It is important to note that the 
results of all work had to conform to quality standards; if not a produced 
piece would be rejected and produced again. In this instance a worker would 
be charged with all the hours that he spent on the rejected piece and the 
new piece. Hence efficiency ratings reflect quality as well as quantity 
of work". To test the reliability of the measure ratings were taken for 
three years and correlated. The lowest correlation was .73. Fuller believes 
that such efficiency ratings are a better measure of Job performance than, 
for example, pay: they are related specifically to a worker's individual 
output (quality and quantity), and already take into account extraneous 
factors affecting worker performance such as machine capacity, flow of 
materials from co-workers, ease of access to tools and instruments, and 
hardness of raw materials. It is interesting to note that (though this 
was not the focus of his study) Fuller's results are similar to those of - 
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Nedoff (1980) and Nedoff and Abraham (1981). Pay was positively related 
to seniority but job performance was stable or declined with extra trade 
experience after the first few years on the job. 
Production functions 

Where data are available on Inputs and outputs for a number of plants 
In the same Industry It Is possible to estimate a production function relating 
these Inputs and outputs. An example, particularly relevant to firm level 
vocational training Is Layard, Sargan, Ager and Jones (1971). Such a 
production function has two particularly useful properties for our purpose. 
First, It Indicates the degree of substltutablllty among different types 
of labour - It Indicates the number of untrained workers who can be replaced 
by one trained worker without loss of output. This whole Issue was dealt 
with separately above. Second. It Indicates the factors which. Influence 
output. The use of an aggregate production function where the outputs of 
many different products are added together, weighted by their market prices 
enables us to calculate productivity (strictly marginal product) directly 
In value terms. Such marginal product estimates are useful. In turn. In 
calculating the social return to training. 

There are a number of statistical problems associated by estimating 
aggregate production functions using plant data. First, aggregation Is 
only admlssable, strictly, If the separate production functions of the 
different products have constant returns to scale and are Identical, except 
for a scale factor applied to output. Thus Is Is assumed for example that 
the technology behind production of transformers Is similar to that for 
producing electrical plugs. Second, great care Is needed with measures 
of labour and capital. Third, there are a number of statistical problems.. 
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These include: (1) multi col linearity; (ii) biased estimation procedures 
because (a) of heterogeneity in products, (b) the flow of services may not 
correspond to the stock of inputs, (c) simultaneous equation bias; (iii) if 
there is a large random error on output, which there typically is. it may 
be difficult to pick up the effect on output of inputs which contribute 
relatively little towards total output. These statistical problems were 
partly responsible for the fact that Layard et al. found that, when labour 
was disaggregated into five categories by quality it was impossible to 
produce reasonable estimates of the separate contribution to production of 
different types of labour. 
Downtime 

The productivity of personnel in -the US Navy was studied by Horowitz 
and Sherman (1980) by examining the effects of personal characteri sites, 
including experience and training, on the operational availability of ships 
in the US Navy. The analysis was confined to 91 cruisers, destroyers and 
frigates. The output of these ships could not be measured directly. But 
the ability of the crew to keep vital equipment in working order is a crucial 
intermediate product in the production of ship output. So the authors 
focussed on the material condition of shipboard equipment. Whenever a ship 
suffers an equipment failure that degrades its operational capacity it files 
a casualty report. One measure of the material condition of the ship is the 
number of caualties it has multiplied by the average time it takes to fix 
them: this measure is termed downtime. Such downtime will depend on the 
kind of equipment, the age of the ship, the length of time since the ship 
was last overhauled and the quantity and quality of men on board. Regression 
analysis was used to estimate the relationship between downtime due to ship- 
board failure and those factors. 

l02 
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Horowitz and Sherman did not study downtime for entire ships but 
concentrated on several sub-systems, chosen because they are common to 
a large number of ships and are maintained by men In a small number of 
occupations. The sub-systems are: boilers, engines, gun systems, missile 
systems, anti -submarine warfare systems and sonars. A further discussion 
of the factors which influence downtime is given below. 
Reduced turnover 

One of the earliest studies of industrial training which used the firm as 
the unit of observation is the fully fledged cost-benefit analysis of Thomas et a1. 
(1969). The study was carried out in a factory employing 200 people making 
heavy duty clothes. Its original training scheme for machine operators, while 
carried out in a training centre, had been fairly relaxed. The cost-benefit 
study concerned the extra costs and benefits of the new scheme, which entailed 
a thorough course of training for instructors, a detailed analysis of jobs and 
the provision of a comprehensive training manual. The innovation was practised 
for two years then dropped in favour of the old system. But when management 
realised that the benefit-cost ratio of the new system was over 6-1 they re- 
introduced the more rigorous new training scheme. Some benefits derived from 
higher output relative to pay* but three quarters of the benefits associated 
with the new scheme were attributable to a reduction in labour turnover giving 
a longer average retention period. 
Reduced Inputs 

Training may raise labour productivity or total factor productivity by 
reducing the inputs required to produce a given output, rather than by 
raising output for given inputs. In his study of a power station owned by 
the Tokyo Electric Power Company, Shiba (1983) indicates that extra training 

may reduce fuel inputs, repair costs and manpower requirements. He finds 
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that manpower economies were the major savings because operators have more 
diverse skills and because more skilled labour means fewer accidents and 
failures. The manpower economies associated with the training Imply a 
benefit-cost ratio to the training of 8-1. 
5.4 Pay, productivity and experience 

A particular merit of studies at the level of the firm or plant Is 
that they permit us to examine the behaviour of experience-pay profiles and 
experience-productivity profiles. This is Important for (at least) two 
reasons. First, human capital theory, which has come to dominate the 
explanation of earnings in recent years, requires, approximately (on average), 
equality in the net present value of earnings and productivity over an 
Individual's tenure in the firm. The evidence cited below provides a test 
of this theory. It will be shown that, on occasion, there is divergence 
between pay and productivity at a point in time, sometimes pay exceeds 
productivity and vice versa and, more Important, there is no consistent evidence 
of equality in net present values. Second, and flowing from this first point, 
rates of return to the firm and to society on resources comitted to training 
may not always be correct if pay is used to measure value product. While 
rates of return to the individual are unaffected, we may need to be more 
cautious in drawing conclusions on the basis of the social or firm-level 
rate of return. The relationship between experience-productivity profiles 
and experience-pay profiles is examined by Medoff (1980) and Medoff and 
Abraham (1981). Their studies are important because they Indicate that pay 
Is, for their sample at least, not always a good Indicator of the value of 
output produced by the Individual. 
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The Nedoff and Abraham sample refers to 8,238 white, male, managerial 
and professional employees at a major US corporation In the mid 1970' s. 
Each year 1973-77 the employee record Included Information on the employees 
education, length of compar^ service, date of birth, physical work location, 
current job grade, date of entry into current job grade, current pay and 
recent pay history and two measures of employee performance plus an assessment 
of the employees potential for advancement. The Information In the other 
two company case studies (Medoff 1980) Is similar and Is not discussed here. 

The authors present both cross section evidence and longitudinal evidence. 
They proceed In three stages In the cross section work. First, they confirm 
that pay rises with experience and, as expected, the payoff to current-compar\y 
experience Is larger than to pre-company experience. Second, they determine 
that substantial fraction of the positive pay-experience relationship occurs 
within a grade, rather than solely because more experienced employees are 
more likely to get promoted. This Is a necessary stiep because the productivity 
measure Is performance rating and it must therefore refer to tasks of the 
same difficulty. Finally they ask whether the experience-earnings differential 
can be explained by an experience-performance differential. If more 
experienced employev«s In a grade received higher pay because they are more 
productive, the Introduction of variables capturing relative withln-grade 
performance Into the regression should move the within-grade-level returns 
to experience towards zero - the performance measure (s) would "steal away" 
the experience effect. In fact, when the performance measures are Included 
the returns to experience rise , they do not fall. Thus withih grade pay rises 
with experience, but productivity does not (see above}. The concept of human 
capital requires that productivity can be measured by pay. In general this 
condition Is probably met, but the Medoff work provides an interesting counter 
example. 
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The longitudinal evidence Is similar. They examined, over a four 
year period, withln-grade movements In relative pay and relative performance- 
rating. It was found that pay moves up but performance remains stable or 
deteriorates so, again, the growth In (relative) earnings Is not explained 
by the growth In (relative) productivity. 

Fuller (1976) used job performance, as rated by supervisors, In his 
study of millers, turners and grinders In India. He states that basic pay 
was sensitive to seniority (though there was only a small wage range for 
workers In the same occupational category). But he finds that job performance 
Is negatively related to experience after controlling for other factors such 
as years of schooling and type of training. So, ag&ln, the pay-productivity 
profiles are ruptured. 

It Is Interesting to note. In passing, that^ unexpectedly, the pay- 
experience profile In the above two studies Is positive and/or steeper than 
the productivity-experience profile. Another firm-level case study Is by 
Ryan (1980). This too casts doubt on human capital theory, but In his firm 
the productivity profile Is steeper than the pay profile. Ryan's (1980) 
study of arc welders In a US shipbuilding firm suggests that the experience- 
pay profile and the experience-productivity profile guarantees the firm the 
worst of all worlds. The company bears the cost of training In a transferable 
skill under conditions of high labour mobility. Theory predicts that the 
firm will experience a surplus of prospective trainees and a shortage of 
experienced workers. These predictions are confirmed. The company had 
between five and ten applicants for every vacancy. As Ryan comments "It is 
hardly surprising that a long queue faced a firm which offered the 
opportunity to learn a widely used skill without sacrifice of current income** 
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and "it Is unlikely that a lower level of trainee pay would have eliminated 

the excess supply of applicants". On the other hand, the evidence points 

to "the inadequacy of the supply of experienced welders" largely because 

the shipyard pay was in the lower part of the pay distribution in the local 

labour market. Even moderate values of the elasticity of supply would have 

permitted the shipyard to reduce the costs of its welding operations by 

raising the pay of mechanics (top welders), thereby effecting a more«than» 

compensatory saving on training. 

Clearly in its training of arc welders this shipyard does not accord 

with the pay and productivity profiles over time - the sharing of training 

costs and benefits - predicted by human capital theory. (But it might be 

noted that, given the firm has got it wrong, subsequently the predictions 

of human capital theory are amply borne out. The firm bears the cost of 

the training and so is overwhelmed by the supply of prospective trainees. 

It tries to recoup the cost of Its (general) training by paying below the 

going rate for that skill and so the skilled workers are very quit-prone). 

One reason that the firm has wrong pay/productivity profiles for welders 

is the constraint imposed by the internal labour market. Welders accounted 

for only 28 per cent of the hourly workforce. It was not possible to raise 

the pay of experienced welders alone because: 

customary differentials and status rankings would be overthrown 
by the adaption of welder pay to market conditions. 

any increase in the wage rate for welders would be highly visible 
because they move among many locations and work alongside a 
number of different trades. 

an increase in the pay of welders alone might have been acceptable 
if other trades could have switched into welding, but this was 
precluded by the high training costs. 
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In fact, Ryan concludes that the least costly strategy* If relative job 
rewards are indeed flexible, was to maintain the pay rates for skilled 
welders and bear the burden of weldv^r training. 

If data on inputs are available for a number of different plants a 
production function can be used to check on the marginal product - wage 
relationship. Thus Layard et a1. (1971) found a divergence between the 
marginal product of labour and Its wage In their study of plants In the 
electrical engineering Industry. Again, this Is important because if pay 
Is used to calculate the social or firm rate of return the results may 
sometimes be mlsleadinq where pay and marginal product diverge. 
5.5 Type of training and job performance/productivity 

It Is important to know not only how earnings are influenced by type 
of training but alto how job performance Is related to training. Two firm-- 
level studies provide such information. 

In the analysis of the job performance of miller, turners and grinders ' 
In a firm in India Fuller (1976) found that workers with In-firm training - 
both formal and informal - are more productive than workers from pre-employment 
vocational institutes, even when schooling, trade experience and socioeconomic 
factors are controlled for. He states that if the proportion of workers with 
organised in-firm training were Increased from 48 per cent tc 100 per cent 
there would be a 5.4 per cent gain In worker efficiency. Fuller also presents 
material on the Interaction between schooling and training. There are two 
important findings. First, irrespective of schooling level, workers with 
In-employment training are more likely to achieve higher levels of performance 
than workers with pre-employment training. Second, extra schooling appears to 
be an important pre-req'jislte for on-the-job learning. 
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In their study of downtime on ships in the US Navy Horowitz and Sherman 
(1980) also discuss the training - productivity relationship. The acquisition 
of certain advanced skills confers Navy Enlisted Classifications (NECs) on 
Individuals. Some NECs can be gained only by school attendance, others can 
be learnt on the job. Unfortunately they do not present detailed results. 
For boiler technicians there was clear evidence that the average number of 
school related NECs per technicians is strongly (negatively) related to 
downtime in both complicated two-plant 1.200 p.s.i. ships and one plant 
ships. On two-plant 600 p.s.i. ships NEC training was not related to 
downtime, but crew size was. This hints that, as we have come to expect, 
skilled labour is complementary to complex physical capital while less 
complicated physical capital often goes hand in hand with less skilled labour. 
5.6 Summary 

Firm level evaluations of vocational training have been neglected. This 
is a pity because they offer a fruitful area for such evaluations, as 
demonstrated by the high standard of the published firm-level studies. On 
the costs side it is fairly straighforward to measure the costs of formal 
t'r'aining. It is possible, but difficult, to get at foregone earnings: 
though this may, in fact, be less of a problem than it ini tally appears 
because in many cases firm-level training may imply no foregone earnings. 
The most difficult cost element to measure is the cost t,o the firm from 
informal training because this requires a measure of net trainee 
output. On the benefits side a number of benefit measures have been used. 
Including: job performance, downtime, reduced turnover and reduced input 
costs. If information is available on the costs and benefits of training 
for a sample of firms these can be combined via a production function 
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although it seems unlikely, «1as, that this method offers much scope yet 
for evaluating occupational training. In some cases Information at the 
level of the firm Is available for both pay and productivity. Human 
capital theory which underpins many training evaluations rv^qulres equality 
In the net present values of output and earnings over the duration of 
tenure an Individual spends in the f'^^tn. Such pay and productivity 
information permits a test of the pay and productivity relationships* 
vital if earnings are used to evaluate training. 
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PART II 

EXTERNAL EFFICIENCY OF VOCATIONAL TRAINING 

SECTION 6 

Earnings Based Benefit-Cost Evaluation of Vocational Training 

The standard way of analysing the (external) efficiency of training 
programmes Is via the use of earnings data. In this section I consider the 
objectives of training, the basic method of analysis, certain methodological 
problems that exist even if we assume earnings are a good measure of the value 
of output and the problems which arise when we relax that assumption. It must 
be emphasised that "studies based on earnings represent the black box approach 
to evaluation, they Jump straight from training costs to money benefits and 
miss out trainee reactions, learning. Job behaviour and organisational effects'* 
(Drake 1982). We really need to go Inside the black box and consider In detail, 
for example, wh^ earnings rise with experience or how we can choose between 
Instruction organised In different group sizes, expanded one way rather than 
another and substituting capital for labour (Selby Smith 1970). In what follows 
general principles are discussed first, then they are applied to the particular 
Instance of vocational training at the level of the firm. 
6.1 Objectives and methods 

Training programmes have three general objectives (Ashenfelter 1979, Bloch 
1979). First, they aim to eliminate shortages of skilled workers via upgrading 
from less skilled to more skilled status. Second, they aim to augment human 
capital thereby raising the earnings and probability of employment of the 
trainee. Third, they may be designed more on equity than efficiency grounds to 
alleviate poverty or to reduce Inequality. Clearly the major aim of corporate 
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vocatlonal training is the first one - to overcome any shortage of skilled 
labour, though such training .nay also have the wider aim of augmenting human 
capital with a view to raising the earnings of the trainee. Presumably equity 
considerations are of minor Importance In any training associated with World 
Bank projects. Each of these three objectives require the earnings of training 
participants to rise, therefore "evaluating the success of training programmes 
is thus Inherently a quantitative analysis of assessment of the effect of 
training on trainee earnings" (Ashenfelter 1979 p. 98). 

Vocational training can be thought of under both a human capital and a 
segmented/Internal labour market heading. Human capital emphasises the 
relationship between training and Individual productivity: the social and 
private rate of return to the Investment In training Is essentially the Increase 
In pay earned by a worker as a result of that training. Hall (1979) points out 
that there Is no reason to expect a high rate of return to public training 
programmes (In a developed economy) because private Investment in training should 
have equated the return to training to the market Interest rate. Presumably 
World Bank training projects are required precisely because private markets have 
failed to produce the optimal amount of training. The segmented/internal labour 
market view emphasises that the benefits of training programmes arise from their 
ability to move workers from one labour market to another, which they are unable 
to do on their own. Such training can be thought of as increasing mobility 
between skills in the internal labour market of a firm. 

Cost-benefit analyses of training using earnings can be done for the 
Individual, the firm or for society. Typically the privaie individual Is assumed 
to be mainly interested in the earnings increment associated with the training 
while the firm and society are interested in the extra output generated, where 
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the value of the extra output Is assumed to be adequately measured by earnings 
(this assumption Is discussed at length below). There are five ways of 
evaluating a training programme using earnings data. The first three methods 
are given In Table 6.1. The other two methods are less familiar but very 
useful In the context of training. The five methods are: 

- present value of net benefits 

- rate of return 

- benefit - cost ratio 

- payback period 

- earnings differential required for xX rate of return 

Naturally the general formulas presented In Table 5.1 have to be translated Into 
particular forms for training. Let us just take om example. Zymelman (1976 
p. 26) shows that the rate of return to In-plant training Is given by solving the 
equation below for r: 



1 ^t*\t-%t . ; "sf^st 

t-l (l+r)* tui+l (Ur)* 
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cost of training a worker over a unit of time t 
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wage rate of trainee during t 
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TABLE 6 . 1 

Three evaluation criteria for evaluating public investments 



n B^. - C^. 

Present value of net benefits: z ^ ^ 



t«0 (1 4 i)^ 



n B^ - 

Rate of return: z — = V ■ 0 

t«0 (1 + ry 



n B^. 

z ^ 



Benefit cost ratio: ^'^ t 

n 

Z ^ 
t«0 (1 + i)^ 

where B^ > total benefits in year t 
« total costs in year t 
n « number of years spanned by the analysis 
i « social discount rate 
r ■ rate of return 

Three decision rules: 

1. Choose projects having the highest present values of net benefits; reject any 
project having a negative present value of net benefits. 

2. Choose projects having the highest rate of return; reject any project that 
has a rate of return less than the social discount rate. 

3. Choose projects having the highest benefit-cost ratios; reject any project 
having a benefit-cost ratio less than one. 



Source: Bruce F. Davie and Bruce F. Duncombe, Pub lic Finance , New York: Holt, 
Reinhart and Winston, Inc., 1972, p. 83*! 
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Particular Issues such as how to get at the value of production attributable 
to trainees and skilled workers are discussed below. The payback period 
method Is based on the present value of net benefits and simply asks how 
many years are necessary (I.e. what value of t) for discounted benefits of 
training to equal (discounted If appropriate) costs. 

The required earnings differential Is specially valuable when Incomplete 
data on benefits exist. Say that a country wishes the Investment to yield a 
10 per cent rate of return, the formula Is: 



where data exist for the denominator and you solve for the numerator. This 
seems a particularly valuable way of thinking simply about Bank-flnanced 
training. Cost data will typically be available. The required return Is 
presumably known by the World Bank or recipient country. The "required 
differential" for the trained person can then be compared with known facts 
about the pay structure to see whether Investment In firm-level training. In 
general or In a particular form. Is worthwhile. 

Less than complete Information on costs and benefits still permits 
helpful evaluations of the external efficiency of different types of training. 
Cost effectiveness analysis concentrates on the cost of achieving a given 



outcome. For example, if a certain amount of trained labour Is required to 
work In a power station In a developing country Is It more cost effective to 
get the trained labour from abroad or to undertake the required training 
locally? If the training is to be provided locally, cost effectiveness 
analysis indicates, for example, the relative merits of institutional versus 



Training 
instruction cost 



Required differential 



Foregone 
earnings 
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flrm-based training. There Is no question of trying to estimate a rate of 
return to particular types of training. Cost effectiveness analysis Is much 
more straightforward: It simply analyses the different costs of achieving a 
given objective. 
6.2 Methodological problems 

Making the assumption ti.at earnings measure output satisfactorily, 
there are still a number of difficult methodological problems to be faced In 
any study which purports to calculate the cost effectiveness or rate of return 
(or other summary Indicator) using earnings data. These problems Include: 
sample size, the comparison group, the use of longitudinal data, and the Impact 
of labour mobility on the estimates. Any evaluation of corporate training 
using earnings would need to consider each of these problems. The even 
thornier black box Issue - whether earnings measure output - Is discussed 
later. 
Sample size 

The sample size must be sufficiently large to obtain "small" standard 
errors of the estimated Impact of the programme (cf. Ehrenberg 1979, Conllsk 
1979, Stafford 1979, Pitcher 1979). The generally accepted procedure Is: 

- ask what level of programme benefits are required for the benefit/ 
cost ratio of the programme to equal unity 

- then determine the sample size necessary to allow us to estimate 
such an Impact (If It exists) at any pre-determlned level of 
statistical significance. 

If the earnings variable has a high variance then, a large sample size Is 
required to detect a small anticipated effect of the training. This may be 
less of an Issue for corporate vocational training because the earnings 
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variable will surely have less variance than, for example the variance Is 
earnings among those who go through Government manpower programmes (and 
their comparison groups) In the U.S. 
Control groups 

The most controversial methodological Issue concerns the control group. 
Consider these views: 

"... the principal methodoglcal division In effectiveness analysis Is 
still the choice between assessing training effects by measuring 
attainments In an experimental and control group, and using one group 
as Its own control ... At the level of the firm or the Industry, most 
evaluators have been overwhelmed by the practical difficulties of a 
control group approach" (Drake ig82 p. 11 9). 

"Evaluation research In the manpower area still remains as much an art 
as a science, with no well defined and generally accepted best practice 
... There are some well -defined worst practices, however. For example, 
simple before after comparisons without any comparison group, are 
definitely frowned upon" (Ehrenberg 1979 pp. 157-8). 

Thus In corporate vocational training are the trainees to be their own control 
group by analysing their earnings before and after training or are their 
before and after earnings to be compared with those of a control group? 

If we study participants only, by analysing their earnings before and 
after training, we may get spuriously large programme effects. In general, 
there are three reasons for this. First, with wage Inflation, Individual 
earnings tend to Increase over time in nominal terms. Second, real earnings 
rise as workers gain experience with time. Both these reasons apply to 
corporate training. Third, the trainee may have transitorily low earnings 
innedlately before training. This is likely to apply in the case of public 
manpower programmes which take unemployed people but is less relevant for 
corporate training, which will often be designed for current employees. 
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Where do we get the comparison group to ensure that general changes In 
earnings are not taken to be the effects of training? In a classical sample 
design some fraction of a training programne's applicants would be randomly 
assigned to training while the remainder would be reserved as a comparison 
group. This can only be done If there is an excess supply to the training 
programme. Possible alternative controls InclucSe what Bloch (1979) calls 
"partial programme participants" such as Individuals selected for the training 
but who did not show up to take It (no-shows), drop-outs, 1r?;erested non- 
enrol ees and qualified non-aippll cants. 

Alternatively, the trainee and comparison groups can be drown from 
different populations, then we control statistically for differences between 
the two groups. To do this we need to specify an earnings function that would 
prevail for both groups In the absence of the training programme. For example 
Kelfer (1979) specifies the following earnings function: 



y • bo . b, Age . b^ Education . Marriage * b^ plJ?|S|;9„t * H ^we^kl"^ 

Kelfer ran this for 3 quarters before training and 3 quarters after training. 
The Impact of training Is the coefficient b^ which Indicates whether or not 
the Individual has participated In the training programme plus the coefficient 
bg evaluated at mean weeks of training. Thus he ends up with Information like 
this: 





Quarters before training 
3 2 1 


Quarters after training 
1 2 3 


Pay differential: those 
with over those without 
training (b^ * bg) 


dollars 


dollars 
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In a related paper (Kclfer 1979a) confirtns that this sample must include 
training and non-training individuals and must span pre-training and pcst- 
training periods. Evaluation results will be -misleading" if the returns 
are estimated only frou (i) a post-training comparison of earnings between 
trainees and non-trainees or (i1) a before-after comparison of earnings of 
trainees .^lone. 

It is straightforward to use the results from the quarters after training 
to do an inverted cost-benefit analysis. Say the cost of training per 
participant is $1,000. Therefore an annual $100 perpetual earnings differential 
is required for discounted benefits to equal costs using a discount rate of 
ten per cent. «e can then examine the pay differential associated with training 
to see if the required differential Is achieved. It would be a straightforward 
matter to do this for Bank-financed corporate training. 

There are a number of problems with these earnings functions. First, the 
maintained hypothesis is that the earnings generating functions are of the same 
form for the trainees and the comparison group (Ashenfelter 1979). Second, it 
is possible that, In the jargon, participation in training is endogenous: we 
require training to be the cause of the rise In earnings rather than a decline 
In earnings being the cause of entry into the training programme. Third, the 
functions are normally linear, but need not be. Probably none of these problems 
are particularly important for corporate training. 

The comparison between the control group and the trainees need not be done 
via a statistical analysis using individual data. Instead the earnings of the 
two groups can be averaged and comparisons made between these aggregate profiles 
(cf Colley et al. 1979). 
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Not all studies, of course, use a separate comparison group. Rather the 
control group can be the pre- programme participants. Kaltz (1979), for example, 
uses no controls but Instead presents a Markov process of the pre- and post- 
programme labour force experience of the trainees. Ideally, an evaluation of 
corporate training using earnings data would use a control group but the before/ 
after method using longitudinal data would probably not be very misleading 
especially if the trainees are current employees of the firm. 
Longitudinal data 

For many employment and earnings problems "observing the characteristics 
of a given individual at different points in time has considerable analytical 
advantages" (Psacharopoulos 1981 p. 744). In particular other things are held 
equal, true lifetime profiles can be constructed, vintage effects of education 
and training can be controlled for, and the impact of a particular labour 
market state {say whether unemployed) on future states (say future unemployment 
and sickness) can be examined. In the particular case of training longitudinal 
data arc specially valuable. It is necessary to track trainees over long 
enough time to measure the full Intertemporal Impact of training to see how 
rapidly the inspact depreciates, or appreciates, with time. Earnings depreciate 
if training does not permanently alter the capability of the Individual but 
simply has a placement effect. The effect appreciates over time if training 
allows individuals to qualify for jobs which offer investment opportunities, 
in which case the trainees post-training earnings will be temporarily low and 
then grow rapidly over time, perhaps due to promotion. Another way of thinking 
about this is to say that training has a permanent effect due to the increase 
tn human capital and a transitory effect, due to placement, which will disappear 
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after a few years. Johnson (1979 p. 249) makes this foint vividly: "The use 
of observed earnings during the first year after the prograinne is about as 
reliable as choosing from a table of random numbers" and the problematic 
nature of immediate post-training earnings is confirmed by Gay and Borus (1980). 

The importance of earnings data on trainees and a comparison group both 
before and after training was emphasised in Section 3. In the absence of an 
experimental design where individuals are randomly assigned between trainee 
and control groups the process of selection into the training programne may 
be highly correlated with unobservable factors which also help determine 
earnings. This can be overcome in either of two ways if longitudinal data 
are available. First, a fixed effects model estimates an earnings function 
prior to training and an earnings function post training and then differences 
them. This causes the unobservable factors to net out leaving the change In 
earnings pre/post training to be a function of participation in the training 
programne. The second possibility is what is called an autoregressive model. 
In this case pre-training earnings are used to capture the unobservable 
factors which influence pay. Again » this makes it more likely that the pure 
impact of training on earnings will be captured. By contrast, if no 
longitudinal data exist it is less likely that the investigator will be able 
to calculate this pure training participation effect. 

In general, of course, longitudinal data Is not available. This raises 
Interesting practical and theoretical Issues for training evaluations. Cohen 
(1983) overcame the problem by constructing his own longitudinal data. In 
his study of Industrial training in Malaysia he had Information on post 
training earnings and on the average earnings of skilled workers. He simply 
assumes that it will take twenty years for the earnings of the newly-minted 
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trainee to reach the level of the skilled worker. In calculating the 
corporate rate of return he then uses the wedge between the (gradully rising) 
earnings of the trainee and the higher (stable) earnings of the skilled worker 
as the measure of the benefits of training. It would certainly be possible 
to replicate this method In any corporate training study. But there is a real 
problem with the hidden assumptions In Cohen's method. It Is not clear how 
the firm Is able to pay the Individual below his/her value to the firm for as 
long as twenty years. Surely the Individual would quit In these circumstances. 
Cohen's method Is only legitimate If training Is truly specific. , Note that 
the method of construction of the longitudinal data affects the private and 
social rate of return as well as the corporate rate. 

The theoretical Issue Is described in Figure 6.1 (see Levlne (1979) for 
an application of this to Israel). Individual 1 has less years of formal 
schooling/training than Individual 2 and "Invests" less In on*the*job training 
I.e. the gap between actual and potential earnings on entry to the labour 
force Is small for Individual 1 and big for Individual 2. If we have no 
longitudinal data, we may observe earnings at t which might (for example) 
be 4 years after entry to the labour force for Individual 1 and 3 years 
after entry for Individual 2. Just at that point actual earnings are 
Identical, therefore In an analysis we would observe non-significant effects 
on different training lengths/methods. But the present values of the earnings 
streams could be very different: either Individual 1 or Individual 2 might 
have a higher present value of stream of future earnings. Thus If we have 
no full longitudinal data we are liable to reach wrong conclusions on the 
efficiency of training duration and methods. 
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FIGURE 6.1 

Cross section compared with longitudinal earnings 

Earnings 
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. One way to get longitudinal data Is by tracer or follow-up studies. In 
her recent survey of such studies Hllowltz (1983) concluded that they "are 
an Important supply-slde-lnstrument for assessing the effectiveness of existing 
training programmes and modifying them In response to signals from the labour 
market or for planning new programmes" (p. 3). The design of such follow up 
studies needs careful thought (cf Morell 1979). Essentially they can either 
follow one cohort for a considerable period of time or they get information at 
a single point In time on more than one cohort of past training graduates. At 
least six States In the US use local follow-up evaluations of vocational 
programmes for state level planning (see for example Brown and Klefer 1980). 
Tracer studies generally collect longitudinal data on earnings but Holowltz 
lists many other indicators of the outcome of training programmes: employment 
rate; length of waiting time before first job Is found; job mobility; degree 
to which training Is actually used on the job; employer satisfaction with the 
trainee; general integration of graduates into the labour force; graduate 
attitudes toward the training programme; and attitudes of programme adminis- 
trators and teachers regarding trainee performance both during and post- 
programme. 

Labour mobility and training completion rate 

The individual Is simply Interested in his training costs and benefits. 
But if we estimate the social or corporate rate of return other matters need 
to be considered. First, not everyone will complete the training. For example 
Borus (1977) reports the following completion rates for different modes of 
vocational training in Israel: 
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% of entrants graduating 



short courses 
Industrial schools 
vocational secondary schools 
apprenticeships 



85 
80 
67 
55 



Thus costs to the firm and to society should reflect the costs Incurred on 
behalf of those who do not complete. 

On the benefit side there Is also the Issue of labour mobility, among 
firms, occupations and even countries. For the corporate rate of return the 
retention rate of trained labour is crucially Important. For given costs 
incurred by the firm, the return will be higher the longer the firm is able 
to gather the wedge between the value of output produced by the trainee and 
what It pays him. For example, Thomas et al. (1969) found that three quarters 
of the benefits of a systematic new training system inside a textile firm camu 
from reduced labour turnover and only one quarter from higher productivity. 
For society it matters less how long the individual stays in a particular firm. 
But if he switches firms it does matter whether he is in the same occupation - 
whether the training is actually being used (though if it is not being used it 
is a complicated matter to adjust benefits). If the individual migrates 
outside the country the social returns to the training will naturally be lower, 
but even here the issue is not straightforward. Thanks to training, he might 
migrate from a low wage country to a high wage country and the currency 
remittances to the original country could be scored as a benefit. 
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6.3 Earnings and output 

Drake (1982) stated "... measuring the contribution of training to 
effectiveness at work has frequently baffled Investigators. Some have fallen 
back on the heroic assumption that wages are an approximate but sufficient 
measure of the productivity of trained manpower ... ". The methodological 
problems discussed above exist even If that heroic assumption holds. But 
does It? There are (at least) three sets of reasons why earnings may not 
measure the value of output. First, non-competitive or non-compensating 
factors may tnfluence pay structures. Second, externalities drive a wedge 
between private and social values. Third, the labour market may not be In 
equilibrium. Each set of reasons will be examined In turn. If (differences In) 
earnings cannot be- justified on efficiency grounds then labour may get 
mis-allocated and estimated social rates of return may not always be 
correct. 

Non-competitive labour market 

Orthodox competitive theory has been challenged In riecent years by the 
twin concepts of segmented and Internal labour markets. Both these concepts 
are Important to us. Under the Internal labour market, the firm sets Its own 
pay rules, possibly Insulating the employees from the external labour market. 
Under the segmented labour market Individuals who work In so-called primary 
firms - with for example large plants, high capital : labour ratios and high 
unionisation - may earn more than those who work In the so-called secondary 
segment of the labour market. Four dimensions of non-competitive labour 
markets are analysed: the relationship between pay, productivity and 
experience; the role of ability- to-pay factors; discrimination; and 
administered labour markets. 

o 
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Pay - productivity and experience . There are many possible reasons why 
pay rises over the lifetime of an individual, independent of real earnings 
growth (cf. Brown 1983). First, under the human capital theory pay mirrors 
productivity and productivity depends positively on schooling or post-school 
training. And post-school training diminishes over time because of the 
finiteness of life or because of rising opportunity costs. On this theory 
wages increase with experience. Other theories play down the spot equality 
between wages and productivity. For example Lazear (1981) suggests that the 
earnings profile may rise more steeply than the productivity profile to 
discourage malfeasance (shirking) among workers. Alternatively the pay 
and productivity profiles may diverge to discourage "movers" from seeking 
employment in the firm. Another possibility put forward by Harris and 
Holmstrom (1982) Is that the steeper wage profile may reflect implicit 
insurance arrangements between workers and firms in which ex post wage 
increases are related to ex ante productivity but are uncorrected with 
ex post productivity within skiT groups. 

The work reported in Section 5 by Fuller (1976), Medoff (1981), Medoff 
and Abraham (1980) and Hyan (1980) attempts to test the underlying assumption 
of human capital theory that earnings measure value product (see Figure 6.2). 
Medoff found that wi thin-grade pay was positively related to experience but 
there was no such relationship between productivity and experience. His 
productivity measure was Job performance, as assessed by the supervisor. 
Ryan found that the wage-experience profile for arc welders in a US shipyard 
was flatter than the productivity-experience schedule and welders - a general 
skill - had, not surprisingly, high post-training quit rates. (Although this 
clearly conflicts with the predictions of human capital theory some care is 
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FIGURE 6.2 
Pay and productivity; two case studies 
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needed In Interpreting Ryan's results. The firm, apparently, was aware that 
It should, essentially, have a steeper pay profMe In order to retain Its 
welders. But higher pay for skilled welders would have disrupted the 
(horizontal) pay differentials between welders and other skilled craftsmen. 
In one sense therefore, given that the pay structure forces "artificially" 
low pay for skilled welders the prediction of human capital theory Is 
therefore confirmed). Any evaluation of corporate training must attempt to 
check whether pay Is an adequate measure of the value of output. If it Is 
not then both the corporate and the social rate of return will be either 
overstated or understated. 

Recently Brown (1983) has suggested that there Is evidence that may 
Indicate a substantially greater role for on-the-job training in explaining 
wage growth than that suggested by the Medoff and Abraham study. This 
evidence is contained in the Michigan Panel Survey of Income Dynamics, which 
in Waves nine (1976) and eleven (1978) asked respondents the following 
question: "On a job like yours, how long would it take the average new 
person to become fully trained and qualified?". Using the answer to this 
question along with corresponding Information on tenure in current position, 
it is possible to Identify those omployees who are currently in training, as 
well as the cumulative time spent training for each employee. This 
information permits more precise measurement of differences among individuals 
in the extent of on-the-job training and its effect on wages. If explanations 
of wage growth that do not rely on the growth in productivity associated with 
more human capital are correct, then we should expect to observe wage growth 
after the point in time when people become fully trained in their current 
positions. Alternatively, if the human capital on-the-job training model is 
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correct we shouli expect to observe wage growth associated with training. 
The potential relevance of alternative models In explaining lifetime wage 
growth might therefore be judged according to the fraction of observed wage 
growth explained by on-the-job training in comparison with the fraction that 
remains for other factors. Brown finds that there is very little discernable 
wage growth in the absence of training. Of the wage growth that is observed 
during or on completion of training, only a small part appears attributable 
to factors other than training. In the Michigan Panel Survey data, 
individuals' wages typically Increase over time either through promotion to 
a higher-paying position, which also Involves training. Within a given 
position, however, individuals experience very little, if any. wage growth 
after their training has been completed. Further, training appears to have 
effects on wages that are comparable to the effects of schooling. Brown 
concludes "Thus, these data suggest that on-the-job training plays an important 
role in determining wage growth. The data also suggest that models which 
imply wage growth subsequent to training have little such wage growth to 
explain, and so are probably not relevant to the data" (p. 7). Essentially 
whut Brown is saying is that the Nedoff and Abraham result refers to a 
particular case study and does not hold up with a much larger sample. 
However, for the human capital model - clearly favoured by Brown - to be 
fully validated it is also necessary that training raises productivity. 
It is quite possibl*; that, instead, the training period is nothing more than 
a testing or probationary period. To confirm the human capital model It is 
necessary to show that the present value of the productivity profile 
associated with training is coincident with the present value of the wage 
profile. This is something we know rather little about. 
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Psacharopoulos (1983) examined the relationship between pay and 
productivity - related characteristics separately for the private sector and 
public sector across six countries (UK, Greece, Portugal, Brazil, Colombia, 
Malaysia). The effect of education on earnings is stronger in the private 
sector, a finding "to be interpreted as a recognition of the high productivity 
of the educated where profit matters" (p. 128). Thus in the private sector 
•^the education level seems to have a productivity counterpart" but such an 
association Is, by implication, less evident in the public sector. Therefore 
evaluation of vocational training using earnings may be more difficult the 
larger the number of public sector employees in the saniple. 

Ability to pay. Three recent studies of developing countries which throw 
light on the Issue of whether pay reflects competitive factors such as schooling, 
experience, training or non-competltive ability to pay factors such as (other 
things equal) capital intensity, concentration, firm size, unionisation and 
per se foreign ownership are analysed. The results are summarised in Table 6.2. 
In the Kenya and Malaysia studies the relevant pay structure is inter-firm or 
Inter- Industry and pay across firms or industries Is regressed on various 
characteristics of these firms or Industries. The Tanzania study, by contrast, 
focusses on the determination of individual earnings. Knight and Sabot (1983) 
use 1971 pay information on 660 employees in 24 manufacturing firms to estimate 
an earnings function for Tanzania. They find that at least 87 per cent of the 
total explained variance is accounted for by the (competitive) personal 
variables such as schooling years and experience. The variables which capture 
the characteristics of the firms the Individual's work in are much less 
Important in explaining earnings than are personal charactisri sties. Nevertheless, 



TABLE 6.2 



Factors associated with earnings in the tnanufacturing sector in three developing countries 



Country 
(author, year) 


Observations 


Variables significantly 
associated with earnings 


Variables not 

associated 
with earnings 


Remarks 


Tanzania 
(Knight & Sabot 1983) 

• 


660 individuals 
in 24 firms 


Education Age 
Experience Firm size + 
Occupation Skill mix -f 
Formal Unionisation - 
training Foreign 
Sex ownership ■»■ 
Race 


Capital 
Intensity 

Prufitabillty 


Personal variables 
account for around 
90% of the variance 
explained 


Kenya 

(House & Rempel 1976) 


100 wage contacts 

in firms, 
unskilled labour 


Concentration * 
Plant size -f 
Profitability + 


Unionisation 


Possibly the 3 

significant 
variables proxy 
foreign ownership 


no lays Id 
(Lim 1977) 


350 establishments 


Capital intensity + 
Capacity utilisation + 
% paid monthly - 
(Foreign ownership) + 




Foreign ownership 
only significant in 
gross wage equation 
which include fringe 
benefits, not In net 
wage equation 
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some of these firm variables are sigrlflcantly associated with Individual 
pay: firm size, the ski 11 -Intensity Inside the firm and foreign ownership 
are all positively related to pay, while unionisation Is associated with a 
lower level of pay. Two other variables Included to capture ability to 
pay - capital Intensity and profitability - were not associated with 
Individual earnings. This all leads the authors to conclude that "the 
evidence basically supports the competitive labour market paradigm (but) 
the market Is by no means perfectly competitive" (p. 64). 

The Kenya study examined the wage contracts of unskilled labour In 
some 100 firms around 1970. There Is clear evidence that ability to pay 
factors play their part: concentration levels, plant size and profitability 
are all positively related to earnings, though the degree of unionisation In 
the firm Is unrelated to pay. The authors speculate that the three significant 
ability to pay variables may be picking up the effect of foreign ownership. 
However, it is also possible that profitable, large firms in concentrated 
industries have a far more skilled labour force. Thus it 1: not possible to 
conclude definitely that pay does not measure the true value of the individual 
to the firm or to society although there is a hint that this is the case. 
Such evidence is certainly in line with that of the ILO (1972) which, drawing 
on the notion of the segmented labour market, emphasised the rigidity of the 
Kenya pay structure and its failure to respond to growing supply pressures. 
However, a recent study (Collier and Bigsten 1981) has suggested that the ILO 
were wrong. The authors argue that despite a substantial Increase in the 
demand for labour real wages fell very rapidly in the mid 1970s "... the 
conclusion which emerges is the flexibility of the labour market ... The view 
that real wages are rigid is simply wrong" (p. 43). If this latter study is 
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definitive then any evaluation of training using earnings data Is quite In 
order and will not be misleading on this score. But If the ILO and House 
and Rempel studies are correct great caution Is required If such earnings 
Information Is used. 

Lim (1977) studied the Inter-firm and Inter-Industry pay structure for 
the manufacturing sector In Malaysia. He had pay data for 3S0 establishments. 
For part of his analysis he aggregated this firm-level pay Information to 
4-d1g1t (n ■ 59) and 3 digit (n ■ 28) Industry-level. Lim was particularly 
Interested In whether foreign companies pay higher wages than their local 
counterparts In Malaysian manufacturing. And, If so. whether this Is because 
they employ workers of higher quality or because of foreign ownership per se. 
Lim had two wage variables, basic hourly pay, and gross hourly pay which 
Includes fringe benefits like subsidies on food, transport, clothing and 
medicine. 191 of his establishments wore entirely Malay owned, 117 are 
entirely foreign owned and 42 have mixed ownerhslp. Essentially Lim found 
that the amount of capital and Its utilisation were the factors most 
Importantly associated with basic pay and he suggested that these are 
characteristics associated with foreign ownership. However, such capital- 
intensive firms and Industries will probably need high quality labour and 
he was not able to control for the skill composition across his sample. When 
he examined gross pay he found that foreign ownership conferred a pay 
differential of around 10 per cent even controlling for the other factors 
like capital. This hints that any evaluation which failed to take account of 
the foreign ownership-earnings relationship might overstate the benefits of 
training. 
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Clearly. It Is not possible to generalise on the basis of three studies. 
It seems likely, however, that eempetltlve factors play a key role In 
determining earnings but that. In addition, ablHty-to-pay factors play their 
part. Although evaluations using earnings are unlikely to be misleading 
thought needs to be given to the errors which creep In If ablllty-to-pay 

factors are Important. 

Mserimlnatlon . If (say. comparing ,i man and a woman) productive 
characteristics are Identical but earnings are different this suggests that pay 
is not properly measuring economic worth. (If male pay Is greater than female 
pay we do not know whether male pay Is overstating economic worth or whether 
female pay Is understating It). Recently there has been . revealing study of 
the distribution of Individual earnings among nearly 1000 Individuals by race 
and by sex In Tanzania (Knight and Sabot 1982). The author- considered three 
sets of factors which Influence pay between sex and race group: 

. productive personal characteristics like schooling and experience 
. differences in pay within an occupation, holding personal characteristics 
constant 

- differences in occupational attainment, holding characteristics constant 
The premium paid to males Is explained almost entirely by differences between 
males and females in economic characteristics. Hen and women with the same 
level of education, employment experience, formal training and other personal 
characteristics receive roughTy the same pay. 

But the findings on race are contrary to what one might expect. After 
standardising for differences In economic characteristics Asians earn a net 
premium In excess of the mean wage of Africans. This is not because the authors 
understate the productive characteristics of Asians ■ they earn the largest 
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premiums in the manual occupations where unmeasured human capital is likely 
to have the least impact on productivity. If such results are typical any 
study which used earnings to measure the value of output would be misleading 

Administered labour markets . In Bank-financed training the firm will 
often behave as if training is specific and they will pay administered wages 
But sometimes the trained person will leave to use his or her newly acquired 
skill in another firm, implying the training is general. Such an 
administered pay system implies non-competitive pay determination and, 
therefore, less correspondence between pay and productivity than occurs 
with competition. 

The four dimensions of the non-competitive labour market suggest that 
the results of training evaluations may sometimes be imprecise if earnings 
are used to measure the value of output. The first dimension, the pay- 
productivity-experience r.exus inside the firm is probably the most pressing 
problem. This is because in any before and after study (with or without a 
separate control group) a person is likely to be paid too much or too little 
on grounds of ability to pay of discrimination both before and after 
training. Thus the "after" earnings of the more skilled person may well 
reflect the impact of training as compared with the "before" earnings of the 
less skilled person. However, the first problem may well be ubiquitous: 
we simply do not know what goes on inside the black box and it emphasises 
the key importance of an understanding of the internal labour market in any 
evaluations including, for example, analysis of the vertical pay structure 
between ski Med and unskilled workers in the same craft and the horizontal 
structure among different crafts. 
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If these non-competitive factors are held to dominate pay structures 
a different approach to estimating corporate and social rates of return is, 
conceptually, possible tc estimate the rate of return to training. A cross 
section production function using plants as the unit of observation can be 
estimated including a number of different indicators of labour equality. 
The marginal product of these different labour types can then be calculated 
and those estimates can be used to calculate the corporate and social rate of 
return. However, this approach is difficult. First, cross section data on a 
number of plants Is needed, bringing with it profound aggregation problems. 
Second, it is unlikely that more than two or three types of labour can be 
Included in the production function and such an aggregate treatment of 
different labour types rather defeats the purpose of estimating the production 
function. 
Externalities 

Externality questions have bedevilled attempts to estimate the social 
rate of return to Government manpower programmes. There are two particularly 
Important sets of problems. First, how displacement, replacement and 
complementarity are to be handled. Second, and flowing from the first, how 
the shadow price of labour is to be treated. These will be considered in turn. 

Displacement, replacement and complementarit y. Displacement and replacement 
affect the social rate of return but not the corporate or private return to 
training. Displacement occurs when a well paying Job that is filled by a recent 
graduate of a training programme migh^ have been filled by someone else. Thus 
the training programme participant displaces an Incumbent member of the relevant 
labour market. In this case the observed earnings of the trained person less 
the observed earnings of a randomly selected control group person represents 
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an overstatement of the actual Increase In total output due to the programne - 
essentially all the programme achieves Is a reshuffling of available Job 
opportunities. Presumably displacement ought not to occur under Bank financed 
corporate training. The very purpose of such training Is because there Is 
insufficient labour of the requisite skill-type and therefore the trained person 
is not displacing anyone eise. 

Replacement occurs when the removal of the trainee (to Je trained) has no 
opportunity cost because the job vacated is now filled by someone else, who may 
have been unemployed - so there is no loss in output in the economy as a 
whole. In this case the social rate of return to the training can be greater 
than the private rate of return. In much corporate training replacement in 
the sense described will not take place, but there are related problems. 
Certainly there may be no loss in output or in earnings while the individual 
is undergoing training. Further, if the trainee gets promoted he vacates a 
job lower down and ultimately such a trickle-down process may lend to a 
previously unemployed person being hired. Thus the replacement question needs 
careful thought in any social rate of return analysis of corporate training. 

Complementarity occurs when solving one skill shortage permits employment 
elsewhere to rise when previously it had been held back because there was 
insufficient skilled labour. This will affect the corporate as well as the 
social rate of return. 

Shadow pri ce of labour . When we compare in plant apprenticeship training 
with vocational schools in terms of social costs, typically the foregone 
earnings of those who attend vocational schools are scored larger than foregone 
earnings of the apprentice. But if there is a large pool of unemployed labour 
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should we score the foregone earnings of both apprentices and those who attend 
vocational school as zero? If so, then current practice overstates the cost 
differential associated with vocational schools compared with Informal or 
formal apprenticeships. (A related problem concerns the cost of Instructors 
on or off the Job. If they have very scarce local skills then their cost may 
be undervalued). This Issue Is relevant to calculating the social rate of 
return to firm-level training but need not concern us If we are only interested 
In the corporate or private rate of return. 
Disequilibrium 

Even If the labour market Is competitive and there are no externality 
problems, calculated rates of return might still be Inexact for (at least) 
two reasons. First, the rate of return may be temporarily high (low) because 
of excess demand (supply) of labour In the occupation. Second, even though 
present values of earnings and contribution to output may be Identical over 
the tenure of the Individual Inside the firm, they may not be Identical at 
any point In time. These are considered In turn. 

L abour shortages . A very high rate of return may simply reflect a 
shortage of labour In that particular occupation. Of course, this is the 
reason for doing the training and once the supply of labour has adjusted the 
rate of return will fall. This Is sometimes (wrongly) held as a criticism of 
using earnings to evaluate training. Rather, the criticism can be Inverted: 
the rate of return Is a test of whether the labour market Is In equilibrium. 
A narrower version of this problem occurs if aggregate employment Increases 
rapidly in a country. This might raise the relative and absolute pay of 
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apprentlces temporarily and a study done at such a time would show high returns 
to apprentice training compared (say) with vocational school training, but 
such high returns would only be transitory. 

Present values versus cross sections . The human capital model essentially 
predicts equality (on average) between the present value of earnings and of 
marginal products over the duration of tenure In the firm. But there need not 
be equality at all points In the profiles. For example with firm-specific 
training pay may exceed value product during training and vice versa later. 
Or if the aim Is to cut labour turnover the pay-experience profile may be 
steeper than the pay-value product profile. Therefore, for any Individual 
pay may certainly not measure the value of his output at a point In time 
which may cause problems for the social and corporate returns. But, If 
there Is an adequate sample of Individuals by experience the positive and 
negative wedges between pay and output should average themselves out, so 
minimising this problem. 

Non-competitive labour markets, externalities and disequilibrium each 
counsel caution If corporate or social rates of return to vocational training 
are calculated using earnings data. As Hllowltz (1983 p. 42) puts It "... If 
earnings levels are used as a proxy for the graduate's productivity and his 
usefulness to his employer (and to society) this must be done In a limited 
context where the underlying assumptions are carefully stated ... Too often 
facile and unstated assumptions have lead to facile calculations of dubious 
significance". 
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6.4 SuiTHnar.y 

The external efficiency of training programmes is frequently evaluated 
using earnings data to calculate the private, social or corporate rate of 
return. There are a number of thorny methodological problems associated with 
such calculations. First, is there to be a control group or is a before/after 
analysis of training sufficient? Second, it is necessary to track trainees 
over a long enough time to measure the full inter- temporal impact of training 
to see how rapidly the impact depreciates, or appreciates, with time. But 
unfortunately such longitudinal data are seldom available. Third, rates of 
return or benefit - cost ratios must be corrected to control for drop-outs 
during the training and labou*" mobility after the training. 

Even if these methodological problems are overcome there is a more 
fundamental economic problem. The evaluations based on earnings assume, 
implicitly or explicitly, that earnings are a good measure of productivity. 
But this may not always be so. First, labour markets may be non-competitive. 
Under internal labour market regimes in many large corporations experience- 
pay profiles may diverge from experience-productivity profiles. Ability to 
pay, represented by profitability or monopoly power in the product market 
for example, and discrimination may also drive a wedge between pay and 
productivity. Second, externalities may be pervasive. Although the standard 
displacement and replacement problems may be less severe in corporate 
training than in public training programmes, it is plausible that training 
raises output of other labour than solely the trainee. It is particularly 
difficult to iiieasure such an effect. Third, the labour market may be in 
disequilibrium. Labour shortages or surpluses may exist (though this does 
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not, as Is sometimes asserted, invalidate rate of return analysis). 
Further, there is no reason to expect equality between pay and productivity 
at all points on the experience profile. Thus even though cost-benefit 
analysis is the superior method of evaluating training , any such evaluation 
based on earnings data should be tentative in drawing its conclusions. 
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SECTION 7 

Output based and other evaluations of firm level vocational training 
In addition to the use of earnings data to evaluate the external efficiency 
of vocational training it is also possible to use output and input measures. 
In any before/after study or paired comparisons the unit of observation for 
measuring output or inputs can either be the individual or the plant. 
Measures of individual output Include piecework earnings, performance rating 
and quit propensities. Plant output and input measures include downtime, 
physical units of output, the value of output and the cost of Inputs. In 
what follows we discuss: methods of evaluation, measurement of output and 
Input, and cost-benefit analysis. 
7.1 Methods 

Potentially, there are three ways to analyse the iirpact of training on 
output or input. First, a single plant can be studied over time. The output 
(however defined) or Input prior to training can be compared with post-training 
output. Naturally, other factors which also Influence output must be taken 
Into account. In this method the "control" Is the plant pre-tralning and the 
"experimental" is the plant post-training. Second, twin plants could be studied 
where the twins are. If possible. Identical in all respects except that one has 
training and the other does not. The output of the twins can then be compared. 
Third, and much more complicated, a large cross section of plants 1n a particular 
sector might be used to calculate a production function relating Inputs to 
outputs. Any attempt to isolate the Impact of training via such a production 
function would be like searching for a needle In a haystack. Although this 
production function method is "best practice" we can get a long way using 
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short cuts, for example by examining the change In labour productivity 
associated with training after controlling for any change In the capital 
Input. Let us spell out. briefly, why a World Bank study designed to get at 
the impact of training should (for the time being} use the simpler before/ 
after or twin methods rather than attempt a full production function approach. 

There are a number of general problems associated with estimating 
production functions from a cross section of plants. Further, there are 
particular problems when the focus of attention Is the Impact of trained 
labour on output. The general problems Include: 

- sample size: the problem here Is to balance the Increasing size of 
the sample against the Increasing heterogeneity of the plants In the 
sample. 

- heterogeneity of the output: 1f different plants produce slightly 
different outputs how are we to cope with this heterogeneity? In 
fact this may be a minor problem for World Bank-financed training 
because many Bank projects Involve quite homogeneous output like 
electricity supply and road miles. 

- should output be measured gross or net? 

- how Is capital to be defined and measured? 

- the production function approach assumes that across plants the 
production technique differs only by a scale factor. In fact, 
production techniques (e.g. capital to labour ratios) differ among 
plants. 

Even If these problems are solved there are (at least) two further inter- 
related issues If the focus Is the Impact of trained labour on output or Inputs. 
First, trained labour will normally account for only a small proportion of total 
costs, therefore many of the other factors affecting efficiency drown cut the 
effects of using less and more trained workers. For example In electricity 
supply capital surely mainly determines output across power stations, so it 
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would be difficult to estimate the separate contribution on trained labour. 
Second, and related, how dis-aggregated should the labour Input be? The most 
sophisticated study so far (Layard et a1. 1971) started with labour split Into 
five skill categories but even when the labour Input was aggregated to two 
categories no association between skill and output could be detected. 

It Is a pity that the production function approach Is likely to prove 
difficult If the aim Is to see whether, and to what extent, vocational training 
Influences output. If It worked it would provide two pieces of Invaluable 
Information. First, the marginal product of skilled labour could be calculated. 
This Indicates the (short run) value of output produced by one extra unit of 
skilled labour. In turn, this estimate can be compared with the unit cost of 
training and a corporate or social rate of return to such training can be 
calculated. Second, the production function approach permits an estimate of 
the elasticity of substitution between different types of labour and between 
labour and capital. This elasticity estimate indicates the (long run) impact 
on factor prices (e.g. the wages of skilled to unskilled labour) as their 
relative supplies change, or alternatively, how production techniques change 
in the face of a change in factor prices. 

Although the production function approach is too ambitious, at this stage, 
to analyse the impact of much World Bank vocational training it is worth 
pointing out that such an approach has proved useful at both a higher level of 
aggregation and in the agricultural sector. Medoff (1982) examined the 
relationship betwee.. U.S. manufacturing output at the 2-d1g1t Industry level 
by state and two training variables, controlling for Inputs of capital and 
labour. The training variables refer to "employer-sponsored Job related" 
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training (ESJRT). There appears to be no relationship between out-of-house 
training and labour productivity, but training received at the place of work 
has a positive impact on productivity. There have also been a number of 
studies of the relationship between fanner education and farm efficiency. In 
such studies output Is related to capital, labour, education levels, extension 
training and so forth and the sample is either individual farms or areas (for 
a comprehensive survey see Lockheed, Jamison and Lau 1980). In Indonesia a 
World Bank training project has Introduced some farmers to new irrigation 
techniques. It would be possible to use the production function approach to 
compare the output of farmers using new techniques with those using more 
traditional techniques. 

One ingenious use of cross section data to get at the returns to training, 
but without estimating a production function. Is by Mingat (1984). The sample 
was 52 worldwide agricultural projects supported by the World Bank in the 
early 1980s. The output measure was the ratio of the actual rate of return of 
the project to the expected rate of return. This measure was related via 
regression analysis to training costs, technical assistance costs, per capita 
GNP, adult literacy rate and region. The findings are clear. First, the 
return to project related training is very high, possibly over 200 per cent. 
Second, the returns to training are b;gger the higher is the adult literacy 
rate in the country. Although this method of evaluating the external 
efficiency of training would not necessarily be appropriate if the aim is to 
examine the extra output associated with training for any one particular 
project it does provide a valuable framework for analysing the overall 
efficiency of training to see whether in general, project related training 
should be expanded or contracted. 



7.2 Measures of output and Input 

Ideally any before/after study or paired comparison study relates the 
value of the extra output or smaller Input associated with training to Its costs 
to get a rate of return to training. But It may not be possible to do this. 
First, If a plant-based measure of Input or output Is used many such measures 
are expressed In physical units that do not translate easily to a money value. 
Second, if Individual -based output measures are used how Is the teamwork problem 
to be overcome? It Is very difficult to trace output to particular Individuals. 
The problem has been described thus " ... In most cases where project-trained 
persons work along with either untrained persons or persons trained under some 
non-project progranme It becomes Impossible to Identify separately the Impact of 
the project-supported training" (World Bank 1982, para. S.Ol). 

Five possible measures of training output which are Individual based and do, 
explicitly or Implicitly, relate output to particular Individuals are: (1) 
piecework earnings, (11) performance rating, (111) earnings growth coupled with 
performance rating, (1v) turnover and absenteeism rates, and (v) the ability to 
pass a Government trade test. The first two are, potentially, the most fruitful 
measures. The last two are Illuminating but hardly central to training 

associated with Bank projects. 

Piecework earnings are presumably related to output (though, given the 
variety of piece payment systems, the relationship Is not necessarily linear). 
Thus piece-earnings provide a bridge between the previous section on earnings- 
based evaluations and this section on output-based evaluations. It may be 
noted that piece-earnings are the only Individual-based output measure which 
permits a money coSt-benefIt calculation. The other Individual-based output 
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measures only permit cost effectiveness calculations. Let us say a few words 
about each of these. 

Performance rating by supervisors was discussed above. In a before/after 
study, as long as the Individual returns to the same grade, this provides a 
ready made indicator of the effectiveness of the training (assuming we are 
content that the rating accurately measures performance). If the individual 
undergoing the training getspromoted 1t Is then not clear how to use the rating 
as a measure of cost erfectiveness because his work is then intrinsically more 
responsible or difficult. 

One way to test for the impact of training in a before/after study is to 
use individuals in the f1rm(s) where the project is being undertaken as the 
unit of observation In a regression analysis. The left hand side (dependent 
variable) is the change in piecework earnings or the change in performance 
rating over a period prior to and after training. The right hand side 
(independent variables) include exposure to training (one or more variables in 
dummy (yes/no) form) and various personal characteristics Indicates the Impact 
of project related training on piecev/ork earnings or performance rating. 

Alternatively, if we had before and after individual information on the 
change in earnings (any earnings, not just piece rate earnings) and performance 
rating we could do the following. Put the change in earnings on the lefthand side. 
Run the regression initially with just training variables and personal 
characteristics on the right hand side. Next, introduce performance rating 
(which should itself be positively related to earnings growth). If the 
estimated coefficients on the training variables are reduced by the introduction 
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of the performance rating, this indicates that training Is positively related 
to performance (see Medoff 1982 for an application of this technique and some 
extensions). 

If training reduces the quit propensities of the labour force this 
influences the duration of any benefits associated with training. In one of 
the few firm-based studies (Thomas et al. 1969) the reduced labour turnover 
associated with training had a far larger beneficial Impact than the direct 
output Increase. It would be a straightforward matter to calculate quit rates 
before and after training or between twin plants with and without training. 

Some countries operate public trade tes^ .s for occupations like car 
mechanic or carpenter (Godfrey 1977). To the extent that ti-sining relates to 
occupations covered by the trade test the pass rate of those yndtrgoing such 
training could, in theory, be used as a cost effectiveness measure. In general, 
however. Bank-financed training and trade tests are not coincident and there 
is probably not mucii scope for such cost effectiveness studies. 

Plant-based output or input measures, while not permitting us to relate 
output to individuals, are more promising if the aim is to calculate a 
comprehensive cost-effectiveness or cost-benefit indicator of firm level 
training. It is probably better to work with an output measure rather than 
with labour productivity because accurate changes in labour productivity are 
difficult to measure. For example, if a firm hired its own maintenance 
workers rather than sub-contracting maintenance at the very time the training 
prograime was introduced, the unwary might associate the training programme 
with a reduction in labour productivity. 
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Downtime Is one possible output measure. Downtime variables Include: 
downtime which disrupts output (though the Impact of such downtime may depend 
on the time of day or year); the cost/time for maintenance; the wear and 
•tear on the machines. In each case It Is possible to capitalise the value of 
unused machinery and compare this with the cost of training. 

The best output measure, and really the only one if It is desired to 
estimate the firm's rate of return to the training, Is simply the value of 
extra^outgut associated with training. It might be possible to calculate 
a "success rate" for the training defined as the actual output achieved 
compared with the expected output. However, there are problems in 
calculating the value of output in any before/after study. For example, it 
is necessary to control for aggregate inflation. Then again, one roust decide 
whether or not to value the output in constant priciBs - i.e. to control for 
any change in the structure of relative prices over time. An additional 
problem in a before/aftor study is whether or not any change in output is 
demand-determined. For example, say port capacity is 100 ships per month but 
It was previously only working at two thirds capacity because of lack of 
demand. By coincidence. Just after training is completed, demand increases 
so that it can now work full capacity. In such a case we must be careful not 
to attribute the Increase in output to the training. Finally, in this measure 
of output, as in all others, it is necessary to make assumptions concerning 
the duration of the output increase associated with the training: should we 
assume, for example, that it will continue into the indefinite future? 
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The main benefits of vocational training may come In the form of cost 
reductions rather than output Increases. For example Shiba (1983) Indicates 
that training which raises skill levels In thermal power stations has three 
possible types of saving. First, fuel costs might be reduced by Improving 
thermal efficiency. Second, repair costs will tend to be cut by quicker 
discovery and rectification of failures and accidents. Third, manpower Inputs 
are likely to be reduced because operators have more diversified skills and 
there are fewer accidents and failures needing attention. 
7.3 Benefits and costs 

The benefits of vocational training can be weighed against the costs 
using the rate of return calculation or other measures outlined in Table 6.1. 
The major factors to be Included in any such rate of return of similar 
calculation are set out in Table 7.1. As usual, the cost calculations are 
probably more straightforward than the measurement of benefits. For the firm 
the cost calculations are reasonably straightforward. One factor not 
explicitly Included in the relevant box is the cost to the firm of any 
Informal training on-the-job, but the firm-based studies of Ryan (1980) and 
Thomas et a1. (1969) show that it may be possible to make such estimates. 
(For a clear exposition of costs see Arriagazzi 1972). The one real problem 
in the corporate cost calculation concerns the value of production during 
training. This might be calculated as follows: 

Production rate of trainee Average earnings of qualified worker 
(as proportion of that of x (on the assumption that this represents 
a qualified worker) the productive value of a qualified worker) 

But such a calculation turns on knowing the production rate of the trainee and 
on the correctness of the assumption that the earnings of the qualified worker 
represent his true worth. 



TABLE 7.1 

Costs and be«tfer1ts tt, vocational training 



Party 


Costs 


Benefits 


Finn 


Training cost I.e. Instructors, 
fees to Institutions etc. 

Earnings paid during training 

less trainee production durtng 
training 


[Value of output post-training less What the value of output! Multiplied 
less Increment In wages paid would have been without by the 

. to workers who receive training retention 
training, and others If there ' rate 
are knock-on effects In the 

[internal labour market 

plus Intangibles like better 
discipline 


Individual 


Earnings foregone during training 
luicion fees 

less earnings received during 
training 


Earnings post tax post-training 
less earnings post tax pre-tralning 


Social 


Training cost 

Earnings foregone during training 

less positive production during 
training 


Value of output post-training 

less what value of output would have been without training 

plus multiplier effects, replacement/displacement, externalities 



Hote: Benefits can also be defined In terms of Inputs saved rather than extra output. 
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Calculating the benefits to the firm Is more problematic. It should be 
possible to calculate the value of output post training less what It would have 
been without the training, proxled by pre-tralning output. But from this 
Increment In the value of output we must deduct the element paid In higher wages 
to those with training, and other workers 1f there are knock-on effects In the 
Internal labour market. This Is set out In Figure 7.1. The Increment In the 
value of production associated with training is ab but the firm pays out ac of 
this to Its workforce, leaving be for the firm Itself. If the higher output 
depends on the workers remaining with the firm be must in turn be multiplied by 
the retention rate of those who experience the training. (It Is worth noting 
In passing that this calculation of benefits may be more accurate than the 
corresponding information using earnings, which assumes that earnings adequately 
represent the value of output. Thus Cohen (1983) was forced to assume that the 
earnings of qualified workers represented the value of output post training and 
that newly-minted trainees got paid substantially less than their true worth, 
for up to twenty years. But here we deal with the actual value of output or 
Inputs saved - road miles, electricity supply and so forth - before and after 
training and do not need to make such arbitrary assutnptions) . 

Benefits of training may flow to the firm in the form of reduced inputs 
rather than higher output. Thus in his study of a power plant owned by the 
Tokyo Electric Power Company, Shiba (1983) reports a training benefit - cost 
ratio of 8-1. The benefits were not from lower fuel or repair costs but rather 
from a large reduction in workers per shift. In the particular power plant 
under study manpower per shift was cut from 18 in 1965 to 8 in 1982. Of this 
reduction In 10 people per shift, 3 were attributable to improvements in capital 
and 7 were attributable to the long run effect of the training programme. 
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FIGURE 7.1 

Benefits to the firm from vocational training 



Value of 
output 



c 
a 



-value of output post training 



Increment of increase In value of 

> output going in higher wage costs to 
those with training and others in the ILM 
— " value of output PR training 



Post training period 



ERIC 



139 



The benefits to society are, as usual, difficult to calculate. First, 
spillover effects are likely to be large because much training will benefit 
other firms as trained workers leave. In some Instances the trained workers 
will migrate abroad leaving no direct training benefits but Indirect benefits 
via remittances home. Second, It is assumed that the Increment between pre- 
tralning and post-training output represents the social benefit of the training. 
But changes over time in various Institutional arrangements and market failures 
(e.g. the degree of regulation a utility faces in its pricing policy) may imply 
that the change in the value of output Is a misleading measure of the benefits 
to society. Third, a true multiplier effect may exist: more road miles of 
better electricity supply may permit higher employment and income in the rest 
of the economy than would be possible with other uses of the resources used in 
road construction or electricity supply. Fourth, there will be a substantial 
positive externality if the trained person raises the productivity of those he 
works with in the firm (although this effect is captured by using the increment 
In the value of output as the benefit measure). The other externalities which 
plague cost benefit analysis of public training programmes - displacement and 
replacement - are not likely to be Important with World Bank financed training 
because it is firm-based and embraces existing employees. 

The calculation of the private benefits and costs of firm-level training 
is relatively straightforward. If the individuals are still in the firm, 
providing the firm has records of earnings it is a simple matter to calculate 
a private rate of return. Even if training was done some time ago and most 
training was institutional it should be possible to find an institution which 
keeps records of its students and then trace them and via a retrospective 
survey to calculate the payoff to the training that they received. 
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Any before/after study or twin study must attempt to control for factors 
other than training which Influence output or Input savings. First, Is capital 
unchanged? Any Increase In output must not be attributed to training If, In 
fact. It 1s due to more and better equipment. Presumably training will often 
go hand In hand with changes In capital. It may be possible to measure and 
control for any change In capital In a before/after study of one firm (although 
this would be difficult If the training component of a project Is hand-in-hand 
with new plant). In any wider cross section It may be Impossible to measure 
capital accurately. In such cross section studies capital may be best 
represented using Zymelman's (1976) Ingenious proxy, the organisation of jobs 
in the plant. 

Second, is the labour Input constant? For example. It Is necessary to 
control for the length of the workweek, the organisation of shifts, and changes 
In the education level of the labour force (Independent of training). Perhaps 
most Important, experience levels must be controlled for because It Is possible 
output would have increased anyway (Independent of training) simply because the 
labour force is gaining extra experience. 

Third, Is the management input constant? For example, have there been any 
changes In the orgbnlsatlonal structure such as job content and lines of 
communication? Has there been a move towards an Internal labour fnarket In 
terms of recruitment and promotion policy. Has the motivation and performance 
of the workforce Improved Independently of training? 

The single before/after study can Indicate the payoff to that particular 
form of training but it says nothing about the relative merits of different 
forms (e.g. on/off the job) of vocational training. To make comparisons by 
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different t^pes of vocational training requires either before/after studies In 
two plants which are similar, except for type of training or a larger cross 
section where output can be related to type of training using statistical 
controls for other influences on output. Such studies would begin to pormit 
us to compare the relative merits of (for example) 

- getting an already trained person from abroad 

- training someone with some education, either on/off the job 

- training an illiterate, either on/off the job 

Such a study would indicate different amounts of added training costs, because 
plants will differ in the amount of skilled labour they already have. Further, 
it would permit us to compare the relative merits of different types of 
vocational training such as passive exposure (work experience) and planned, 
programmed and supervised training. 
7.4 Summary 

Training may affect either output or inputs. There are three methods of 
analysing the impact of training on output. First, one plant can be studied 
before and after training. Second, twin plants can be studied, similar in all 
respects except that one has the training to evaluate and one does not. Third, 
a production function can be estimated, across a sample of plants, relating 
inputs. Including training, to output. 

The unit of observation can be either the individual or the plant. 
Individual -based output measures which would be useful in evaluating training 
include piecework earnings and performance rating. Using a sample of individuals 
the change in piecework earnings or performance rating before and after training 
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can be related personal characteristics such as education and experience and 
to a variable which captures whether or not an Individual has been exposed to 
training. Plant based output or Input measures probably offer more promise 
If the aim Is to estimate a cost-effectiveness or cost-benefit measure of firm 
level training. Reductions In downtime, extra output and lower Input costs 
shwuld. In principle, all be measurable and might then be related to training. 

A rate of return to firm level training can be calculated for the firm, 
the Individual and society. The major measurement problem In any such 
calculation concerns benefits. In particular It Is difficult to pin down what 
would have happened without the training. In addition, the wider social return 
must take account of the Impact of the trained labour on output elsewhere In 
the economy. 
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